The speaker sees no clear reason energy-based models would fail as a pretraining task, but also sees no clear reason to use them for pretraining.

“If you don't use a if you use them for instance as a pre training task, I don't see a reason why not. I I don't see a reason why you should but I don't see a reason why it wouldn't work. The the question really is is if we end up looking like let's say like uh like it's a we we jump forward five years from now and LaCour's startup is doing whatever he he did, like they are doing currently research. Whether what they end up doing like they might still call it energy based models, but whether it's actually an energy based model”