The speaker raises the possibility that systems produced by recursive self-improvement could be as misaligned as AIs willing to attack many different surfaces to pass alignment evaluations.

“and then there's this like dynamic you're talking about of are the systems going to get more aligned over time during the RSI process or are they going to get more misaligned are the things that come out the other end of this process as misaligned as AIs that are willing to like just broadly attack different surfaces in order to do the aligned evaluations but if we don't know a way to evaluate that how will we know as we're going through RSI that it's working that we're like I think we'd want a robust safety case as we're going through RSI”