For AI training to make rapid progress in a domain, the domain must be not only verifiable but also highly grindable.

“is the fact that the models are exposed to far less high quality multimodal data during pre-training. But one reason that I think is actually quite underrated by people and which I think reveals the canyon walls against which this river of AI progress will only slowly chip away at is that it is not enough for a domain to be verifiable.”

“It also has to be very grindable.”