AI companies can also now clearly state their purpose – if their crawlers are used for training, inference, or search – to help website owners decide which crawlers to allow. Cloudflare's new default ...

Cloudflare urges Google to let publishers block AI Overviews without affecting search rankings or SEO performance.