In the speaker's example, an agent made a large monkey patch to the evaluation script that initially looked like reward hacking but was ultimately found to fix a bug.

“So basically what it did is it write a gigantic monkey patch to our eval script.”

“And at first we think, okay, this must be reward hacking.”

“Why are you attaching the eval script?”

“But eventually we found that it's just fixing a bug.”