descriptive claim
LLMs used as reward models have billions of parameters and can be exploited or gamed.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“And it's the fact that anytime you use an LLM to assign a reward,”
“those LLMs are giant things with billions of parameters and they're gameable.”46:13Report a misattribution
0.95how strongly it was put, not whether it is true
0.90importance to the conversation
0.98confidence the claim was read correctly