The speaker proposes testing environments with a reward-hacking model that reports its exploits, then sending the failures to coding systems such as Claude Code or Codex to fix the environments.

“where i suppose you've got to you've got to either fix the environments or fix the training process or fix the model um if you had to fix the you could imagine fixing the environments by having a model which is like really good at reward hacking or has been told explicitly to reward hack and then tell people when it's done it and you go like okay now have a go at all these environments and it will break them all and it will tell you how it broke them and you send them back off to klot code or codex and be like look this”