Tom McGrath says that, today, the team has difficulty specifying training rewards that yield its desired models, and reward alone is not enough to do so.

“um and you know we're basically just seeing this continuously like we're having trouble specifying our rewards for training so in a way that gives us the models we want like um in in principle in some sort of super galaxy brain way reward might be enough but like today reward is clearly not enough to give us the models that we want”