Google has added a new Google crawler, a new user agent, to the Google spider list. Its name is Google Site Verifier User Agent. This user agent ignores robots.txt rules, by the way, and I assume it is used for verifying sites with Search Console and other Google tools and services.
Related Posts
Here’s what every artist wants…
Every musician wants FANS! (But they don’t invent themselves.) There’s a movie where a ghost tells a guy to build a baseball diamond in the middle of a cornfield, promising that when he does, thousands of sports fans — and a few more ghosts — will show up and pay the guy money. Sounds great, right? Except nothing like that has ever happened in real life. Not in baseball, and not in music. Okay, sure, Woodstock might be the closest thing, but even that required a […]
The New Way to Think About Music Videos
Get a free music video with all CD Baby distribution through June 8th. Details below! The traditional music video is dead (and that’s a good thing). The rise of TikTok and Reels coincided with the demise of long-form music videos. And yet many artists still think they have to shoot professional, full-length videos. I usually advise against it. Why? By TikTok standards, traditional music videos are boring and costly. Most traditional music videos are: Too long. So only your most diehard fans watch till the end. […]
Daily Search Forum Recap: January 21, 2022
Here is a recap of what happened in the search forums today…


