The benchmark-versus-realism tradeoff might explain some behavior of smaller Anthropic models such as Sonnet 5, although the speaker is uncertain about their post-training methods.

“So you might, that might even explain”

“something about the smaller anthropic models like Sonnet 5 though it's hard to predict exactly what what they're doing to post train those models it could also be that they're always changing their post training stack and they just made they just got a few things wrong in some of these models so they like I don't know they they turned up like so something too high and created some quirks that people really don't like”