Training a model on its own traces produces better learning than training it on another model's traces, according to the speaker.

“Maybe the last thing I would say here is that models-- every model family has very different distribution, and one of the more recent learnings in the field of AI has been that if you train the model on its own traces, it learns much better than if you train it on someone else's traces.”