AIO APEX

News

Breaking news and updates from the world of technology.

Cloudflare starts blocking AI crawlers that hide behind search bots by default
Internet & Network

Cloudflare starts blocking AI crawlers that hide behind search bots by default

New defaults taking effect today block AI training and agent crawlers on ad-supported pages unless they clearly declare their purpose, closing a loophole multi-purpose bots like Googlebot previously used to gather training data under cover of search indexing.

Cloudflare Blog
ai-crawlerspublishers