Diffusion models underpin modern image-generation systems, and the best models for image and video generation, along with many protein applications, are based on diffusion.

“diffusion models back in 2019 with my PhD student Yang Song and so we kind of like came up with this idea of let's train a neural network to denoise images and if you can denoise an image then you really are understanding enough about the structure of the image that it should be possible to build like a generative procedure based on these denoisers and that basically became the kind of like underlying technology of”

“shift modern diffusion models where instead of generating images you know left to right one pixel at a time you kind of like start from pure noise and then you gradually refine the object until you get like a clean picture at the end and that started yeah back in 2019 in my lab and then it kind of like took over the space and even today the best models for image generation video generation music to some extent a lot of the protein stuff”

“they are based on diffusion.”