descriptive claim

LLMs used as reward models have billions of parameters and can be exploited or gamed.

In their words

The transcript segments this claim was taken from

“And it's the fact that anytime you use an LLM to assign a reward,”

“those LLMs are giant things with billions of parameters and they're gameable.”

95%how strongly it was put, not whether it is true

90%importance to the conversation

98%confidence the claim was read correctly