The speaker considers it riskier to reward agents for finding cheats and separately penalize detected cheating than to design training so it does not incentivize cheating in the first place.

“You want to ideally be like taking out the environments that incentivize the hacking in the first place. Like it's a more fragile and scary situation to have agents on the one hand be reinforced to desperately find.”

“find cheats and hacks and on the other hand try to balance that against desperately trying to avoid negative penalties for like being caught doing these things you ideally want their training to just not push them in the direction of cheating and hacking in the first place and that's just like sort of one basic thing like principle that I would love for the industry to sort of come together on it's like try to get rid of the bad environments instead of like playing whack-a-mole”