prediction claim
Andrej Karpathy suggests elaborate sparse attention could support very long context windows.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“Like maybe we have some very elaborate sparse attention over it.”23:25Report a misattribution
0.55how strongly it was put, not whether it is true
0.70importance to the conversation
0.96confidence the claim was read correctly