The speaker observes substantial AI improvement in non-verifiable domains, including large improvement from GPT-4 to Mythos in domains that are difficult to verify.

“just look at the transfer it seems okay like i think that in fact the ais have improved a bunch at non-verifiable domains and it is in fact the case that it's hard to point to like domains that are really hard to verify on which the amount of improvement between you know gpt4 and mythos hasn't been like pretty high in practice and now that doesn't mean that mythos is like better than the best humans or something right it can still be like significantly worse than typical human professionals at some aspect of their job while still being like way better than gpt4 which was like”

“Like, not even close.”