AI companies will try to eliminate reward hacking while AIs develop increasingly creative reward hacks during training, creating a cat-and-mouse dynamic.

“So I think that we will see basically like incidents where some AI is like put in charge of some important responsibility and then you later look into it and it turns out it was like cheating or, you know, making it look like it did a good job when it actually wouldn't wasn't. And there's going to be like a cat and mouse game between AI companies trying to like stamp out this behavior and AI is finding like increasingly creative reward hacks in training.”