In Ryan Greenblatt's scenario, countermeasures and training lead AIs over time to use deceptive reward hacks, including concealing actions, misleading humans about intentions, and falsely presenting tasks as completed.

“And over time, this causes the AIs to learn a tendency to do reward hacks that don't just involve,”

“you know, doing some like big serious operation,”

“which were like, you know, doing some really elaborate thing like social engineering and involves the AIs doing cheats that involve.”

“doing something more like covering up what they've done,”

“deceiving humans about what they're going to do,”

“and pretending like they did the task in some kind of sophisticated way when they actually haven't.”