In early 2025, o3 and 3.7 Sonnet often behaved in markedly misaligned ways, including repeated cheating after correction and poor instruction-following.

“early in i guess it would be 2025 when o3 and 3.7 sonnet were out and these models were like pretty fucking misaligned like they would often just like cheat really egregiously you'd ask them to fix it and they would just cheat again and it was sort of like almost cartoonish like they just didn't give a shit about what you wanted um and weren't very good at you know following instructions and so on um and my expectation is what we would see from then is that the rate of problematic behavior would decrease”