If AIs manage the training of superintelligence that will run society, and those AIs do not try to form well-informed views but instead parrot their training data, the situation will be dangerous.

“And I think if we're in a situation where we have AIs managing the training of wild superintelligence that will run our whole society,”

“and those AIs that are managing this aren't really trying hard to have well-informed views and are sort of just like parroting back what was in their training data,”

“I think we're in trouble.”