John Mueller of Google said there is no percentage of traffic you should expect from your Googlebot activity compared to other bot and traffic activity on your site. Meaning you don’t need to worry if Googlebot is taking up 2% of your server resources and not 20% of your server resources.
Related Posts
PSA: Blocking USA Users But Allowing Googlebot Is Against Google’s Webmaster Guidelines
Google sends its crew of crawlers, Googlebot, from the United States. That is where 99% of the crawling originates from. If you are not allowed to show your website to users based in the United States, then you also cannot show that website to Googlebot.
Harness the power of customer data to stay ahead of the competition by Cynthia Ramsaran
Attracting interest in a tool or product may be the easy and fun part of building a business, but converting inquiries to purchasers is when it gets hard. So many brands today continue to struggle with acquiring, converting, retaining and creating loyal customers for life. Yet leading companies across the globe seem to be accomplishing all of that and then some. Want to know how? Register and attend “Harnessing the Power of Customer Data to Stay Ahead of the Competition,” presented by Tealium. Click here to […]
Google: Noindexed Pages Do Not Impact Crawl Budget via @sejournal, @MattGSouthern
Google’s Search Relations team confirms noindexed pages don’t adversely impact a website’s crawl budget, no matter how many a site has. The post Google: Noindexed Pages Do Not Impact Crawl Budget appeared first on Search Engine Journal.


