Mythos may still be substantially worse than typical human professionals at some job tasks while being much better than GPT-4, which was far from comparable in those respects.

“just look at the transfer it seems okay like i think that in fact the ais have improved a bunch at non-verifiable domains and it is in fact the case that it's hard to point to like domains that are really hard to verify on which the amount of improvement between you know gpt4 and mythos hasn't been like pretty high in practice and now that doesn't mean that mythos is like better than the best humans or something right it can still be like significantly worse than typical human professionals at some aspect of their job while still being like way better than gpt4 which was like”

“Like, not even close.”