LIVE TICKER
[Live wire]Connecting to the newsroom…
← Back to the news wire
Flesch Reading Ease: 57•134 words from the publisher
AIPublished by The Decoder • 11/21/2026, 4:23:45 PMOpen Original Report (The Decoder) ↗

Nvidia researchers argue huge AI context windows are a dead end

Language models can now process entire novels at once. An Nvidia research team says that's often overkill and expensive. In many tests, periodic summaries and targeted lookups worked about as well.

Nvidia researchers argue huge AI context windows are a dead end
Image supplied by The Decoder.

Reported by The Decoder

Language models can now process entire novels at once. An Nvidia research team says that's often overkill and expensive. In many tests, periodic summaries and targeted lookups worked about as well.

A language model's context window is its working memory, covering everything it holds in view when generating a reply. Over the past few years, that window has grown rapidly. GPT-4 launched in March 2023 with 8,192 tokens. Today, GPT 5.6 Sol handles around one million tokens, about 120 times as much and enough for Tolstoy's "War and Peace."

Every week, our editors pick the AI news that matters and explain what it means. No hype, no spam.

More from the original report

Follow The Decoder for AI news, background stories and expert analyses.

Ask a question about the article or an AI topic. You can ask follow-up questions.

Original Source Attribution
Published via The Decoder • Source domain: the-decoder.com
Visit Original Source (The Decoder) ↗

Client & Community Discussion (0 Comments)

Share your benchmark feedback, workflow questions, or implementation notes below.

● Live Comments Open
Instant publication • Moderated for technical relevance