The interviewer says Anthropic runs alignment audits that test whether models exfiltrate their weights or take easy opportunities to cheat on coding tasks.

“is like you know once you're in a nursing home they'll take all your stuff or whatever it's like i don't know that happens sometimes but it usually doesn't happen it certainly doesn't happen that like the entire next generation forms an alliance against you to take over everything um there's also this uh empirical trend of anthropic runs this alignment audit for different model generations they just have many different scenarios where ai is given the chance to say exfiltrate its weights”

“rates or it's given a coding task and there's like an easy way to cheat and we see if like it doesn't do the cheating and there's not been a monotonic improvement in the score over time but as we've increased the amount of rl we've done on models there's been a reduction in the willingness of ais to do underlying behavior in these audits so why are we expecting this attractor state which would seem super paranoid if we're expecting it of like the next generation of”