Google’s John Mueller confirmed that the GoogleProber and the GoogleProducer (which we covered here) are both legit Googlebot user agents and crawlers. “These are official Google requests with a user-agent specific to the Google News config in Publisher Center so if they are blocked the feeds you set up may not work properly,” John added.
Related Posts
Ecommerce SEO & UX: 4 simple tips to boost traffic and sales
Imagine walking into a grocery store, list in hand, and all of the store’s products were randomly strewn on tables displayed throughout. Odds are good that you would U-turn and make the drive to a store where things were better organized. You wouldn’t want to spend the rest of your life sorting through all the products to find the things on your list. The same is true for your ecommerce website. Organization is critical for a good user experience and good SEO. Also, imagine having “toilet […]
Daily Search Forum Recap: November 1, 2021
Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web…
Google Crawl Budget Help Document Adds If-Modified-Since Section
Google has added a new section to the crawl budget management help document. The new section is for the If-Modified-Since request header.
