The speaker argues that saying AI systems are aligned with humanity leaves unresolved whose values they follow, including a president's, a CEO's, or values aggregated through a broad democratic process.

“We build A.I.s, they're aligned to humanity, but to who? Like, s you know, is it the president, is it the CEO? Is it some actually broad and good democratic process that aggregates everyone's values in sort of an endorsed way? Um, you're probably NOT gonna be the last one, and so you know...”