descriptive claim
Architectural innovations have substantially increased how much information or context transformers can store.
Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026
In their words
The transcript segments this claim was taken from
“There's been tons of architectural innovations that dramatically increase the amount of information or the amount of context that a transformer can store.”Play from 1:58Report a misattribution
95%how strongly it was put, not whether it is true
80%importance to the conversation
99%confidence the claim was read correctly