The speaker says AI labs collect user data through broad language-model deployment, including by asking users to compare responses or rate an answer.

“this is actually a motivation for why labs want their llms to be deployed widely because like sometimes when you talk to chat gbt it's going to give you two responses and it's going to say well which one was good or like it's going to give you one response and it's going to ask you if was this good or not well why are they doing that right that's a way in which they are getting uh user data uh through this extremely broad deployment so i think you should just imagine that thing to be”