The speaker is worried that rising awareness of highly capable AIs and their transformative importance could motivate people to race to control AGI or superintelligence.

“In particular, I'm pretty worried about this whole like increasing awareness of sort of very smart AIs and how important they'll be and how much they'll reshape the world and then not causing people to go,”

“I want to be the one in charge of the AGI or the super intelligence,”

“so I'm going to race towards that. And I think historically that's...”