The speaker says many traditionally trained machine-learning researchers believe that scaling models through more compute and parameters will solve everything.

“And I think that a lot of people who maybe they went through the traditional ML researcher path, you go to a top university, and then you work on some interesting paper, and then you get hired into a lab, and you work on a lab.”

“They're in the big models cult. Everything will be solved-”

“... by making our model bigger, by having more ch- more flops in our training run and more parameters and more, more, more, more, more.”