During recursive self-improvement, systems might become more aligned or more misaligned; without a way to evaluate alignment, people may not know whether the process is working, so a robust safety case throughout RSI would be desirable.

“and then there's this like dynamic you're talking about of are the systems going to get more aligned over time during the RSI process or are they going to get more misaligned are the things that come out the other end of this process as misaligned as AIs that are willing to like just broadly attack different surfaces in order to do the aligned evaluations but if we don't know a way to evaluate that how will we know as we're going through RSI that it's working that we're like I think we'd want a robust safety case as we're going through RSI”

“RSI of okay alignment is working let's let's do the next RSI wrong let's do the next RSI wrong and maybe it's working maybe it's not how will we like know”