Google Tests AI Opt-Out to Ease Regulatory Pressure

Google LLC is testing a new setting that enables website owners to opt out of AI-generated answers without impacting their search engine rankings. The move follows an order from the UK's Competition and Markets Authority and an ultimatum from Cloudflare regarding the company's use of Googlebot for both search indexing and training its Gemini AI model.

Regulators and industry critics argue that bundling these functions forces publishers into a binary choice between maintaining search visibility and protecting their content from AI scraping. Cloudflare CEO Matthew Prince highlighted the scale of the issue, reporting that AI agents generated 57% of web traffic in 2026, surpassing human traffic for the first time.

In response to the pressure, Google is rolling out the opt-out feature globally after initial tests in the UK. Cloudflare had previously threatened to block mixed-purpose crawlers for its ad-supported customers starting September 15 to protect publisher content.