Cloudflare AI bot controls now divide crawlers into Search, Agent, and Training categories, letting publishers independently ...
Come 15 September, multipurpose crawlers used by the likes of Google, Microsoft and Apple will be blocked by default according to Cloudflare's new rules.