descriptive claim
Andrej Karpathy says language models restart from scratch when initialized with an empty context window.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“when you boot them up and they have zero tokens in the window,”
“they're always like restarting from scratch where they were.”Play from 22:09Report a misattribution
80%how strongly it was put, not whether it is true
80%importance to the conversation
96%confidence the claim was read correctly