4 sources healthy · latest episode 9 Nov 2026
prediction claim

A couple more years of progress might produce transformer context windows that feel infinitely large.

Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026

In their words

The transcript segments this claim was taken from

“And why not think with a couple more years of progress we might have what feels like infinitely large context windows?”
2:06Report a misattribution
0.55how strongly it was put, not whether it is true
0.80importance to the conversation
0.99confidence the claim was read correctly
A couple more years of progress might produce transformer context windows that … · Savlar