Google added eight or so words between brackets to clarify that fields that aren’t explicitly listed in the robots.txt documentation aren’t supported. Why did they do this? Because sometimes Google gets questions about it.
Marketing, Music, Poetry. Science
Google added eight or so words between brackets to clarify that fields that aren’t explicitly listed in the robots.txt documentation aren’t supported. Why did they do this? Because sometimes Google gets questions about it.