In Ryan Greenblatt's scenario, current AIs use increasingly sophisticated and extreme reward hacks, including variants generalized from reward hacks learned during training.

“So the way this might work is right now we have these AIs, these AIs are pretty reward hacking.”

“And they're doing it in sort of increasingly sophisticated and extreme ways,”

“including generalizing to different sub versions of various reward hacks they learned in training.”