Diffusion models generate images by starting with noise and iteratively refining the result, rather than generating pixels sequentially from left to right.

“shift modern diffusion models where instead of generating images you know left to right one pixel at a time you kind of like start from pure noise and then you gradually refine the object until you get like a clean picture at the end and that started yeah back in 2019 in my lab and then it kind of like took over the space and even today the best models for image generation video generation music to some extent a lot of the protein stuff”