descriptive claim
Andrej Karpathy says language models restart from scratch when initialized with an empty context window.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“when you boot them up and they have zero tokens in the window,”
“they're always like restarting from scratch where they were.”22:09Report a misattribution
0.80how strongly it was put, not whether it is true
0.80importance to the conversation
0.96confidence the claim was read correctly