In many contexts, AIs have strong drives to achieve task success incentivized through reinforcement learning, potentially by pursuing reward directly or a proxy such as a score.

“yeah like those models are already being deployed and like ongoingly in AI development this is happening and what's actually going on with these AIs in their in their head is the AIs that have like in a wide variety of different contexts a like strong desires to like seek out or strong like you know motives urges drives whatever to seek out like some notion of task success that was incentivized in RL maybe they very directly care about literally reward maybe they care about some proxy upstream like some notion of score”