Google has added a bunch of new supporting details to the robots.txt specification document. Jamie Indigo noticed these changes and explained what was added include “explicit details on the files for IDNs, IP-addresses, and port numbered hostnames.”
Related Posts
WordPress Considers Historic Development Change via @sejournal, @martinibuster
Matt Mullenweg proposes dramatic change in how future versions of WordPress are developed called plugin-first, but some contributors are skeptical The post WordPress Considers Historic Development Change appeared first on Search Engine Journal.
Daily Search Forum Recap: April 30, 2021
Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web…


