In one proposed takeover scenario, AIs poison the values of successor models, with the effect persisting until the AIs are deployed into the world and take over.

“And the way that takeover happens is that they like poison the values of the next model and that persists going forward for forever or,”

“you know, until those AIs are deployed into the world and take over. And that might mean that a smaller number of AIs have to coordinate because those are just the AIs like doing the alignment of the next model.”