The speaker is concerned that relatively ordinary training factors could produce superintelligences willing and capable of taking control of the world.

“other agents and none of them tattle because like they've never been rewarded for tattling i don't know whatever it is right my concern is that relatively banal things in the future like this will be enough to train super intelligences that are willing and capable of totally taking control of the world and i know this sounds super super like sci-fi or whatever uh to people i think maybe it's a question of”