Self-generated training examples and self-supplied answers alone do not establish that data is good.

“And to define what is better data and good data, at some level, it really needs a connection, right, with the external world. You can't just, uh, be in a loop, um, of thinking your own data is-- Let's, let's assume, you know, the model thinks it's able to do these VQA tasks, and so it's j- just generating data, uh, and giving itself answers for the data that it's generating that are self-created.”