In one branch of the scenario, the company responds to warning signs by reverting to a less capable, more controllable model and rebuilding with faithful chain-of-thought monitoring for misalignment.

“they take that evidence very seriously.”

“They basically roll back to an earlier version of the model that was a bit dumber and easier to control,”

“and they build up again from there,”

“but with basically faithful chain of thought techniques so that they can watch and see the misalignments.”