The speaker says current models are substantially more capable than the average software-engineering task demands, with some benchmark tasks being quite complex.

“the models have more and more intelligence and they're like so much more intelligent now than like the average software engineering task like you look at the like terminal bench ones and they're like solve like the jacobian conjecture not really but like you know it's like they're they're quite complex like i would not have been able to do this really as a software engineer”