- Google launched a new tool that lets publishers opt out of training Google's AI models.
- More and more top-ranking websites are using it.
- Google is not being blocked as much as OpenAI, though. There may be a good reason for this.
There's a grand bargain at the heart of the web: A small piece of code that has maintained order for decades.
Robots.txt lets website owners choose whether to let Google and other tech giants scrape their online content. Most sites have let Google do this because the company distributes so much valuable traffic.