The speaker argues that active learning benefits from density representations and rejects the claim that ordinary deep learning is not performing inference.

“So if you're interested in something like active learning, then you also want densities. So I would push back on the fundamental notion that we are not doing inference if we look at uh like normal deep learning.”