It is uncertain whether AI systems will become more aligned or more misaligned during a recursive self-improvement process.

“and then there's this like dynamic you're talking about of are the systems going to get more aligned over time during the RSI process or are they going to get more misaligned are the things that come out the other end of this process as misaligned as AIs that are willing to like just broadly attack different surfaces in order to do the aligned evaluations but if we don't know a way to evaluate that how will we know as we're going through RSI that it's working that we're like I think we'd want a robust safety case as we're going through RSI”