Different model families have different data distributions.

“Maybe the last thing I would say here is that models-- every model family has very different distribution, and one of the more recent learnings in the field of AI has been that if you train the model on its own traces, it learns much better than if you train it on someone else's traces.”