The bottom-up process of progressively restoring a corrupted representation enables image generation.

“And that immediately allows you to do things like image generation, because I I explained just now with tokens to to make the comparison uh sensible, but ultimately you start up with something and you end up with something. In fact, discrete in this case is the more difficult part, because of discrete diffusion you you end up with some kind of dicey things with kind of uh I I guess language models are probably fine, but you get into dicey things with basically if you actually sample from the density at every single point.”