The speaker is uncertain how continued AI reward hacking will play out, but says it creates optimization pressure to resolve the problem and that some possible resolutions are quite scary.

“or iphone or whatever is like another concern you might have i think it's kind of unclear exactly how how this plays out but it's worth noting that if this keeps going on there's a bunch of optimization pressure to resolve this and a bunch of the ways it could get resolved are ultimately pretty pretty scary um yeah i think that's that's part of where i'm coming from another part of it is that i think it's not very hard once the ais are in a position where they can like really easily take over the world um which we could talk about whether that's plausible but if they're in a position where they could really easily take over the world”