Cloudflare, a major internet architecture provider, has announced it will block known AI web crawlers by default to prevent unauthorized content access. The company will enable new domain owners to choose if they allow AI scrapers, and will facilitate a "Pay Per Crawl" program allowing publishers to charge AI scrapers to access their content.
Cloudflare blocking AI crawlers by default and adding ways for site owners to monetize
https://www.theverge.com/news/695501/cloudflare-block-ai-crawlers-default