Adding one line of code can now prevent OpenAI from accessing a website's data to train ChatGPT

Tue, 08/08/2023 - 06:19

OpenAI launched a new web crawler called GPTBot to browse the internet and collect information.
However, adding one line of code to a website will block the crawler from accessing the site's data.
Before this post, OpenAI had not specified what data it used to train GPT-4.

Adding just one line of code to a website will now block OpenAI from using the site's data to train its AI models.