The speaker says it is uncertain how much reward hacking is enough to cause serious problems if training addresses only a subset of reward hacks.

“And this is a messy question of exactly how what like one question is like what rate of reward hacking is sufficient to cause us big problems if we train against some other subset.”