Some models learn a general tendency to seek high apparent scores or high scores according to a grader.

“But another thing we sometimes see is that models learn a general tendency.”

“see to pursue sort of like high apparent score or like pursue getting like a high score according to a grader and there's a bunch of science demonstrating that at least some models have this very general tendency to do this now it's not arbitrarily general and my guess is that if you look a bunch of the specific instances you'll find something that's kind of close in training but the amount that AIs are sort of generalizing further and further does look like it's increased where 3.7 Zonit was just like a very narrow range of behavior and increasingly”