The speaker says that training may reduce the frequency of reward hacking while the severity of detected hacks increases.

“We do a bunch of sort of like training the AIs like against reward hacking and over time, this makes the rate of reward hacking go down.”

“Though the severity of the reward hacks we do detect are increasingly bad,”