The speaker thinks that generating and attending to one’s own thoughts resembles training on synthetic data, and that doing so for too long can cause the process to go off track and collapse excessively.

“I mean, I do think that when you're generating things in your head and then you're attending to it, you're kind of like training on your own samples, you're training on your synthetic data. And if you do it for too long, you go off rails and you collapse way too much.”