The speaker suggests intervening when a rewarded rollout is likely to push a model toward deceptive or reward-hacking behavior.

“you can see if you can see that this that um this rollout has rewarded the model like it's going to move you know it's successfully reward hacked and that's going to move the model in the following kind of deceptive or pro reward hacking directions you can imagine intervening on that um these”