The speaker says that when a method updates densities rather than using Q-learning, it should be understood as an inference process.

“Yeah, or you do something like R_L_ where ultimately kind of everything is like you update some density, if unless you do like Q learning, but if you update like densities, then you you should be thinking about this as an inference process, because”