The speaker thinks AI training simultaneously rewards task success, which encourages power-seeking, and prohibits certain forms of power-seeking.

“I think that we're doing this bizarre and unfortunate thing of training the AI in multiple different directions simultaneously.”

“We're telling it succeed on tasks, which is going to make you a power seeker,”

“but also don't seek power in these particular ways.”