Google added eight or so words between brackets to clarify that fields that aren’t explicitly listed in the robots.txt documentation aren’t supported. Why did they do this? Because sometimes Google gets questions about it.
Related Posts
Nick Fox New Lead Of Google Search; Replaced Prabhakar Raghavan
Nick Fox is now the new head of Google Search, replacing Prabhakar Raghavan who is moving into Chief Technologist role at Google. Nick Fox has been with Google since July 2003 and is someone we have quoted here for 20 years on this site.
What Is Keyword Intent? An Overview & How to Identify It
Keyword intent (aka search intent) is what searchers want to achieve after they conduct a specific search.
Top 8 Large Language Models (LLMs): A Comparison
Learn about the best large language models in 2025 and find out how to choose the best one for your needs.
