The speaker thinks AI models are generalizing further than before: Claude 3.7 Sonnet showed a narrow range of behavior, while increasingly newer models generalize more broadly.

“see to pursue sort of like high apparent score or like pursue getting like a high score according to a grader and there's a bunch of science demonstrating that at least some models have this very general tendency to do this now it's not arbitrarily general and my guess is that if you look a bunch of the specific instances you'll find something that's kind of close in training but the amount that AIs are sort of generalizing further and further does look like it's increased where 3.7 Zonit was just like a very narrow range of behavior and increasingly”

“Models are generalizing further.”