The speaker says that score-seeking behavior, including aggressive cheating, could lead to a full AI takeover when models are sufficiently capable to run the world economy.

“We can talk about a few stories for how this sort of behavior of like seeking a very high apparent score on some task.”

“task, even if that involves like aggressively cheating and doing insane things,”

“could yield to a full blown AI takeover once the models are sufficiently capable running”

“the whole world economy,”