AI models can analyze thousands of words at a time. A Google researcher has found a way to increase that by millions.

• A recent research paper revealed a new way to help AI models ingest way more data. 
• "Ring Attention" removes a major memory bottleneck for AI models. 
• Soon, you'll be able to put millions of words into context windows of AI models, researchers say.

Right now, ChatGPT can ingest a few thousand words at most. Bigger AI models can handle more, but only up to about 75,000.

What if you could pump millions of words or whole codebases or big videos into these models?