Good data must, at some level, be connected to the external world.

“And to define what is better data and good data, at some level, it really needs a connection, right, with the external world. You can't just, uh, be in a loop, um, of thinking your own data is-- Let's, let's assume, you know, the model thinks it's able to do these VQA tasks, and so it's j- just generating data, uh, and giving itself answers for the data that it's generating that are self-created.”