prediction claim
A couple more years of progress might produce transformer context windows that feel infinitely large.
Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026
In their words
The transcript segments this claim was taken from
“And why not think with a couple more years of progress we might have what feels like infinitely large context windows?”Play from 2:06Report a misattribution
55%how strongly it was put, not whether it is true
80%importance to the conversation
99%confidence the claim was read correctly