The speaker cares about how humans interact with AI, not about AI discussing its own goals.

“What should we make of AI, and how should we res-respond to AI, and what should we do with AI, right? We're having this conversat-- I mean, I'm happy to let AI have its discussion on the side about what, what its goals are and what it should be trying to do, right?”

“That doesn't interest me, right? I mean, you tell me that there's some server in the corner and it's doing whatever it's doing and proving theorems and so on. You know, again, what I care about is how, how am I gonna interact with it?”