The speaker thinks confidence in AI alignment will require fundamental scientific breakthroughs, because observing behavior alone will not determine whether a system is aligned.

“I think in order to be sort of confident in the alignment of our systems, I think we're going to need sort of like more fundamental scientific breakthroughs, where I think you're not going to be able to figure out if the AI is aligned via behavioral evaluation alone,”

“where you just look at what the AIs are doing.”