The speaker rejects the notion that standard deep learning is not performing inference.

“So if you're interested in something like active learning, then you also want densities. So I would push back on the fundamental notion that we are not doing inference if we look at uh like normal deep learning.”