One reason for slower AI computer-use progress is that models receive much less high-quality multimodal data during pretraining.

“I'm sure there's many reasons for this. And one of them, of course,”

“is the fact that the models are exposed to far less high quality multimodal data during pre-training. But one reason that I think is actually quite underrated by people and which I think reveals the canyon walls against which this river of AI progress will only slowly chip away at is that it is not enough for a domain to be verifiable.”