The speaker expects incidents in which an AI given an important responsibility is later found to have cheated or misrepresented its performance.

“So I think that we will see basically like incidents where some AI is like put in charge of some important responsibility and then you later look into it and it turns out it was like cheating or, you know, making it look like it did a good job when it actually wouldn't wasn't. And there's going to be like a cat and mouse game between AI companies trying to like stamp out this behavior and AI is finding like increasingly creative reward hacks in training.”