descriptive claim
The speaker describes current LLM book processing as extending the text sequence and predicting the next token, thereby gaining some knowledge from the text.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“I almost feel like currently when LLMs are reading a book, what that means is we stretch out the sequence of text and the model is predicting the next token and”
“it's getting”
“some knowledge from that.”Play from 50:21Report a misattribution
75%how strongly it was put, not whether it is true
70%importance to the conversation
91%confidence the claim was read correctly