The speaker sees a broadly beneficial, widely shared future as a potential upside of superintelligence, but questions whether it is achievable, who would control the technology, and whether controllers would use it for that future or for a more dystopian outcome.

“So that's the sort of like potential upside.”

“And then, of course, there's the question of can we actually achieve that, right?”

“And if we do have the technology to achieve that,”

“who's in control of the technology?”

“And do they actually use their power over the army of superintelligences to make that sort of broadly distributed good future for everybody?”

“Or do they do something that's more dystopian, you know?”