Energy-based models are limited by both insufficient function expressiveness and potentially very slow sampling.

“Now you have kind of t the difficulty of both worlds. Like you have the problem of like variation inference where hey what if my function is not strong enough, and then you have the problem of the sampling based world where suddenly you have the issue of uh my actual sampling process is really really slow. So and this is kind of what always limited energy based models.”