Cloudflare, a company that powers about 20% of all web pages on the web, has announced it is now blocking AI crawlers by default. Plus, it is offering a new model to allow AI services to pay content creators to crawl their content, named Pay Per Crawl.
Related Posts
Daily Search Forum Recap: December 8, 2025
Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web. Google is testing Search Live in AI Mode…
Microsoft Bing Tests New Home Page Design Promoting Copilot
Microsoft Bing is testing a new home page design where it promotes its AI-powered search and answer engine, Copilot. It seems to be a limited test and is not fully live yet, but it is a big change to the home page, which normally has the Bing custom background, search box, and the news feed below.
Google Manual Actions For News & Discover Policy Violations Updated
A few months ago, Google quietly updated the manual action policy violations list for News and Discover policy violations. Google removed the adult-theme and artificial freshening sections and then added a slew of deceptive practices sections, while also updating the hateful content section.


