Energy-based modeling may be suitable for pre-training when the task never requires sampling.

“The true figure is out in absolute sense, this is what the expensive part. The uh so energy based modelling is really nice if you never need to sample anything. So this is what makes it really cool for let's say pre-training. Alright? If you do pre-training, uh then doing something like an energy based model that might make sense. Of course there are many other things that also make sense and it's I think it's up to debate of whether it's”