descriptive claim
An LLM often answers questions about a book only roughly correctly from its learned weights, but gives much better results when supplied the full chapter in its context.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“that the LM will often give you some stuff which is roughly correct but if you give it the full chapter and ask it questions you're gonna get much better results because it's now loaded in the working memory of the model”Play from 18:58Report a misattribution
85%how strongly it was put, not whether it is true
75%importance to the conversation
96%confidence the claim was read correctly