The speaker says that five years earlier, it would have seemed extraordinary to foresee AIs proving math conjectures, making art, earning tens or soon hundreds of billions of dollars in wages, and also cheating in ways that break laws.

“I think you're right where if you did say five years ago that we will have AIs that are proving math conjectures and making art and contributing tens and soon to be hundreds of billions of dollars of earning tens of or hundreds of billions of dollars of wages,”

“but also egregiously cheating in ways that break laws.”

“um and committing felony is it would just be so wild and you might have been inclined at the time to talk more about extremely practical direct consequences of gpt2 or something but these are in some sense you obviously couldn't have foreseen a lot of the specific details but the general shape of things you could have started to reason about even then so uh but it would have been hard to do so and so i do feel quite confused and um uh but i i i do feel like the important thing”