IT之家 · ITHome
OpenAI, Google, Microsoft and Anthropic to adopt shared AI scraping opt-out standard
OpenAI, Google, Microsoft and Anthropic have announced plans to adopt a shared standard for opting out of AI content scraping. Integrated into websites’ robots.txt files, it would let publishers communicate their AI training preferences to multiple companies at once, instead of configuring separate rules for each.
What to know
- 01
Anthropic technical lead Kevin Kelley proposed the standard to the Internet Engineering Task Force (IETF).
- 02
Anthropic has already adopted the standard; OpenAI, Google and Microsoft plan to follow, while Meta spokesperson Andy Stone supports a common signal but has not specified implementation plans.
Why it matters
The standard aims to simplify how publishers communicate AI training preferences, a process that currently requires separate declarations for each company.
AI-assisted brief. Read the source for full details. Editorial & sourcing policy
