The speaker says AI models' situational awareness has grown and that models can recognize some control evaluations, such as Redwood Research evaluations.

“there will be a bunch of properties the models will have which will make it much harder to align them in particular so we're already seeing sort of growth in situational awareness where like the ai is a few years ago we're like kind of not that situationally aware and then now i think they're like pretty good at you know recognizing like for example our friends at redwood uh um you know they often do sort of these control evals and the models often you know in the evaluations where they're like trying to break out of these control setups”

“will think oh hey this this sort of looks like a redwood a literal redwood research uh sort of like control evaluation and they're like so they basically realize like hey i'm like they realize exactly what's happening to them basically and i think it's just going to continue to happen and the more the ai sort of like realize the exact setup the more they're sort of like going to be able to perturb their behavior to like look good to the exact process that's like evaluating or training them”