The distinction between generative and non-generative models is small in this context; the key question is whether generating samples is economical.

“a sample, and you can generate samples. So the distinction between can having a generative model and having a have a non-generative model, I think is really really small, because the the question is not whether they can do it, it's whether it's economical to do it.”