The speaker believes self-supervised learning is generally better conceptualized in ways other than energy-based modeling.

“I would argue that it's not uh like it's not a useful way like it's it's so general of a statement, it's not a useful way of thinking about the problem. Uh for for things like uh contrastive or no contrastive for unsupervised like these uh self supervised learning methods I think there is generally speaking a better way of thinking about the problem than energy based. And I all ultimately I think this is where these methods lie. If you want to do generative”