The speaker says that high school and college students could once train language models at scale, while over the past three years the models have seemingly become fairly capable of producing language and complex thought.

“And so you could still have, like, a high school student or a college student, um, very easily just sort of train these models en masse, right? Um, but over the last, like, three years, uh, they've gotten pretty good, at least seemingly, at producing language and complex thought.”