This task exposes shortcomings in current vision-language-model training and creates a clear incentive to improve these models.

“And I think that just points to a lot of shortcomings in the ways that we're training vision language models and provides like a clear incentive of, uh, how we should be making these models better.”