This repository contains a collection of resources and papers on Diffusion Models and Score-based Models.
If there are any missing valuable resources or papers or any materials related to diffusion model, please do not hesitate to create or pull request to issues. I am happy to reflect them.
Contents
Resources
Introductory Post
A Unified Approach to Variational Autoencoders and Stochastic Normalizing Flows via Markov Chains
Johannes Hertrich, Paul Hagemann, Gabriele Steidl
arXiv 2021. [Paper]
24 Nov 2021
Introduction to deep generative modeling: Diffusion-based Deep Generative Models
Jakub Tomczak
[Website]
30 Aug 2021
What are Diffusion Models?
Lilian Weng
2021. [Website]
11 Jul 2021
Diffusion Models as a kind of VAE
Angus Turner
[Website]
29 June 2021
Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song
[Website]
5 May 2021
Papers
Image
Image Generation
Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021
Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Sam Bond-Taylor1, Peter Hessey1, Hiroshi Sasaki, Toby P. Breckon, Chris G. Willcocks
arXiv 2021. [Paper] [Github]
24 Nov 2021
Diffusion Normalizing Flow
Qinsheng Zhang, Yongxin Chen
NeurIPS 2021. [Paper] [Github]
14 Oct 2021
Denoising Diffusion Gamma Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021
Score-based Generative Neural Networks for Large-Scale Optimal Transport
Max Daniels, Tyler Maunu, Paul Hand
arXiv 2021. [Paper]
7 Oct 2021
Score-Based Generative Classifiers
Roland S. Zimmermann, Lukas Schott, Yang Song, Benjamin A. Dunn, David A. Klindt
arXiv 2021. [Paper]
1 Oct 2021
Bilateral Denoising Diffusion Models
Max W. Y. Lam, Jun Wang, Rongjie Huang, Dan Su, Dong Yu
arXiv 2021. [Paper] [Project]
26 Aug 2021
ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis
Patrick Esser1, Robin Rombach1, Andreas Blattmann1, Björn Ommer
NeurIPS 2021. [Paper] [Project]
19 Aug 2021
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021
SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon
arXiv 2021. [Paper] [Project] [Github]
2 Aug 2021
Score-Based Point Cloud Denoising
Shitong Luo, Wei Hu
arXiv 2021. [Paper] [Github]
23 Jul 2021
Structured Denoising Diffusion Models in Discrete State-Spaces
Jacob Austin1, Daniel D. Johnson1, Jonathan Ho, Daniel Tarlow, Rianne van den Berg
arXiv 2021. [Paper]
7 Jul 2021
Variational Diffusion Models
Diederik P. Kingma1, Tim Salimans1, Ben Poole, Jonathan Ho
arXiv 2021. [Paper] [Github]
1 Jul 2021
Deep Generative Learning via Schrödinger Bridge
Gefei Wang, Yuling Jiao, Qian Xu, Yang Wang, Can Yang
ICML 2021. [Paper]
19 Jun 2021
Non Gaussian Denoising Diffusion Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper] [Project]
14 Jun 2021
D2C: Diffusion-Denoising Models for Few-shot Conditional Generation
Abhishek Sinha1, Jiaming Song1, Chenlin Meng, Stefano Ermon
arXiv 2021. [Paper] [Project] [Github]
12 Jun 2021
Score-based Generative Modeling in Latent Space
Arash Vahdat1, Karsten Kreis1, Jan Kautz
arXiv 2021. [Paper]
10 Jun 2021
Learning to Efficiently Sample from Diffusion Probabilistic Models
Daniel Watson, Jonathan Ho, Mohammad Norouzi, William Chan
arXiv 2021. [Paper]
7 Jun 2021
A Variational Perspective on Diffusion-Based Generative Models and Score Matching
Chin-Wei Huang, Jae Hyun Lim, Aaron Courville
ICML Workshop 2021. [Paper] [Github]
5 Jun 2021
Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling
Valentin De Bortoli, James Thornton, Jeremy Heng, Arnaud Doucet
arXiv 2021. [Paper] [Project] [Github]
1 Jun 2021
On Fast Sampling of Diffusion Probabilistic Models
Zhifeng Kong, Wei Ping
ICML Workshop 2021. [Paper] [Github]
31 May 2021
Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho1, Chitwan Saharia1, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
arXiv 2021. [Paper] [Project]
30 May 2021
Gotta Go Fast When Generating Data with Score-Based Models
Alexia Jolicoeur-Martineau, Ke Li, Rémi Piché-Taillefer, Tal Kachman, Ioannis Mitliagkas
arXiv 2021. [Paper] [Github]
28 May 2021
Diffusion Models Beat GANs on Image Synthesis
Prafulla Dhariwal1, Alex Nichol1
arXiv 2021. [Paper] [Github]
11 May 2021
Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021
Noise Estimation for Generative Diffusion Models
Robin San-Roman1, Eliya Nachmani1, Lior Wolf
arXiv 2021. [Paper]
6 Apr 2021
Diffusion Probabilistic Models for 3D Point Cloud Generation
Shitong Luo, Wei Hu
CVPR 2021. [Paper] [Github]
2 Mar 2021
Improved Denoising Diffusion Probabilistic Models
Alex Nichol1, Prafulla Dhariwal1
ICLR 2021. [Paper] [Github]
18 Feb 2021
Maximum Likelihood Training of Score-Based Diffusion Models
Yang Song1, Conor Durkan1, Iain Murray, Stefano Ermon
arXiv 2021. [Paper]
22 Jan 2021
Learning Energy-Based Models by Diffusion Recovery Likelihood
Ruiqi Gao, Yang Song, Ben Poole, Ying Nian Wu, Diederik P. Kingma
ICLR 2021. [Paper] [Github]
15 Dec 2020
Score-Based Generative Modeling through Stochastic Differential Equations
Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole
ICLR 2021 (Oral). [Paper] [Github]
26 Nov 2020
Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable Models
Fan Bao, Kun Xu, Chongxuan Li, Lanqing Hong, Jun Zhu, Bo Zhang
ICML 2021. [Paper]
16 Oct 2020
Denoising Diffusion Implicit Models
Jiaming Song, Chenlin Meng, Stefano Ermon
ICLR 2021. [Paper] [Github]
6 Oct 2020
Adversarial score matching and improved sampling for image generation
Alexia Jolicoeur-Martineau1, Rémi Piché-Taillefer1, Rémi Tachet des Combes, Ioannis Mitliagkas
ICLR 2021. [Paper] [Github]
11 Sep 2020
Denoising Diffusion Probabilistic Models
Jonathan Ho, Ajay Jain, Pieter Abbeel
NeurIPS 2020. [Paper] [Github] [Github2]
19 Jun 2020
Improved Techniques for Training Score-Based Generative Models
Yang Song, Stefano Ermon
NeurIPS 2020. [Paper] [Github]
16 Jun 2020
Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song, Stefano Ermon
NeurIPS 2019. [Paper] [Project] [Github]
12 Jul 2019
Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit
Belinda Tzen, Maxim Raginsky
arXiv 2019. [Paper]
23 May 2019
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli
ICML 2015. [Paper] [Github]
2 Mar 2015
A Connection Between Score Matching and Denoising Autoencoders
Pascal Vincent
Neural Computation 2011. [Paper]
7 Jul 2011
Bayesian Learning via Stochastic Gradient Langevin Dynamics
Max Welling, Yee Whye Teh
ICML 2011. [Paper] [Github]
28 June 2011
Image-to-Image Translation
Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021
UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models
Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon
arXiv 2021. [Paper]
12 Apr 2021
Image Editing
Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper] 26 Nov 2021
Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Sam Bond-Taylor1, Peter Hessey1, Hiroshi Sasaki, Toby P. Breckon, Chris G. Willcocks
arXiv 2021. [Paper] [Github]
24 Nov 2021
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021
SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon
arXiv 2021. [Paper] [Project] [Github]
2 Aug 2021
Super Resolution
Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021
S3RP: Self-Supervised Super-Resolution and Prediction for Advection-Diffusion Process
Chulin Wang, Kyongmin Yeo, Xiao Jin, Andres Codas, Levente J. Klein, Bruce Elmegreen
arXiv 2021. [Paper]
8 Nov 2021
Autoregressive Diffusion Models
Emiel Hoogeboom, Alexey A. Gritsenko, Jasmijn Bastings, Ben Poole, Rianne van den Berg, Tim Salimans
arXiv 2021. [Paper]
5 Oct 2021
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021
Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho1, Chitwan Saharia1, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
arXiv 2021. [Paper] [Project]
30 May 2021
SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models
Haoying Li, Yifan Yang, Meng Chang, Huajun Feng, Zhihai Xu, Qi Li, Yueting Chen
arXiv 2021. [Paper]
30 Apr 2021
Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021
Text-to-Image
Vector Quantized Diffusion Model for Text-to-Image Synthesis
Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen, Bo Zhang, Dongdong Chen, Lu Yuan, Baining Guo
arXiv 2021. [Paper] [Github]
29 Nov 2021
Blended Diffusion for Text-driven Editing of Natural Images
Omri Avrahami, Dani Lischinski, Ohad Fried
arXiv 2021. [Paper] [Github]
29 Nov 2021
DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Models
Gwanghyun Kim, Jong Chul Ye
arXiv 2021. [Paper]
6 Oct 2021
Adversarial Attack and Defense
Adversarial purification with Score-based generative models
Jongmin Yoon, Sung Ju Hwang, Juho Lee
ICML 2021. [Paper] [Github]
11 Jun 2021
Medical Imaging
Score-based diffusion models for accelerated MRI
Hyungjin Chung, Jong chul Ye
arXiv 2021. [Paper]
8 Oct 2021
Graph Generation
Permutation Invariant Graph Generation via Score-Based Generative Modeling
Chenhao Niu, Yang Song, Jiaming Song, Shengjia Zhao, Aditya Grover, Stefano Ermon
AISTATS 2021. [Paper] [Github]
2 Mar 2020
Audio
Audio Generation
Denoising Diffusion Gamma Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021
Variational Diffusion Models
Diederik P. Kingma, Tim Salimans, Ben Poole, Jonathan Ho
arXiv 2021. [Paper] [Github]
1 Jul 2021
CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis
Simon Rouard1, Gaëtan Hadjeres1
arXiv 2021. [Paper] [Project]
14 Jun 2021
PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior
Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
arXiv 2021. [Paper] [Project]
11 Jun 2021
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu1, Chengxi Li1, Yi Ren1, Feiyang Chen, Peng Liu, Zhou Zhao
arXiv 2021. [Paper] [Project] [Github]
6 May 2021
Symbolic Music Generation with Diffusion Models
Gautam Mittal, Jesse Engel, Curtis Hawthorne, Ian Simon
arXiv 2021. [Paper] [Code]
30 Mar 2021
DiffWave with Continuous-time Variational Diffusion Models
Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, Bryan Catanzaro
ICLR 2021 [Paper] [Project] [Github]
21 Sep 2020
DiffWave: A Versatile Diffusion Model for Audio Synthesis
Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli
ICML 2021 (Oral) [Paper] [Github] [Github2]
21 Sep 2020
WaveGrad: Estimating Gradients for Waveform Generation
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, William Chan
ICLR 2021. [Paper] [Project] [Github]
2 Sep 2020
Audio Conversion
DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversion
Songxiang Liu1, Yuewen Cao1, Dan Su, Helen Meng
arXiv 2021. [Paper] [Github]
28 May 2021
Audio Enhancement
A Study on Speech Enhancement Based on Diffusion Probabilistic Model
Yen-Ju Lu1, Yu Tsao1, Shinji Watanabe
arXiv 2021. [Paper]
25 Jul 2021
Restoring degraded speech via a modified diffusion model
Jianwei Zhang, Suren Jayasuriya, Visar Berisha
Interspeech 2021. [Paper]
22 Apr 2021
NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling
Junhyeok Lee, Seungu Han
Interspeech 2021. [Paper] [Project] [Github]
6 Apr 2021
Text-to-Speech
Guided-TTS:Text-to-Speech with Untranscribed Speech
Heeseung Kim, Sungwon Kim, Sungroh Yoon
arXiv 2021. [Paper]
32 Nov 2021
EdiTTS: Score-based Editing for Controllable Text-to-Speech
Jaesung Tae1, Hyeongju Kim1, Taesu Kim
arXiv 2021. [Paper]
6 Oct 2021
WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, Najim Dehak, William Chan
arXiv 2021. [Paper] [Project] [Github] [Github2]
17 Jun 2021
Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech
Vadim Popov1, Ivan Vovk1, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov
ICML 2021. [Paper] [Project] [Github]
13 May 2021
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu1, Chengxi Li1, Yi Ren1, Feiyang Chen, Peng Liu, Zhou Zhao
arXiv 2021. [Paper] [Project] [Github]
6 May 2021
Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon, Byoung Jin Choi, Nam Soo Kim
Interspeech 2021. [Paper]
3 Apr 2021
Miscellaneous
Data Imputation
CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
Yusuke Tashiro, Jiaming Song, Yang Song, Stefano Ermon
arXiv 2021. [Paper]
7 Jul 2021
Handwriting Synthesis
Diffusion models for Handwriting Generation
Troy Luhman1, Eric Luhman1
arXiv 2020. [Paper] [Github]
13 Nov 2020
Natural Language Processing
Zero-Shot Translation using Diffusion Models
Eliya Nachmani1, Shaked Dovrat1
arXiv 2021. [Paper]
2 Nov 2021
Time-Series Forecasting
Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf
ICLR 2021. [Paper]
2 Feb 2021
Applications
Deep Diffusion Models for Robust Channel Estimation
Marius Arvinte, Jonathan I Tamir
arXiv 2021. [Paper] [Github]
16 Nov 2021
Deep diffusion-based forecasting of COVID-19 by incorporating network-level mobility information
Padmaksha Roy, Shailik Sarkar, Subhodip Biswas, Fanglan Chen, Zhiqian Chen, Naren Ramakrishnan, Chang-Tien Lu
arXiv 2021. [Paper]
9 Nov 2021
Crystal Diffusion Variational Autoencoder for Periodic Material Generation
Tian Xie1, Xiang Fu1, Octavian-Eugen Ganea1, Regina Barzilay, Tommi Jaakkola
arXiv 2021. [Paper]
12 Oct 2021
217 Oct 30, 2022
3 Jun 03, 2021
71 Dec 22, 2022
3 Jul 30, 2022
89 Jan 01, 2023
264 Nov 08, 2022
83 Dec 23, 2022
2 Nov 14, 2022
16 Oct 14, 2022
41 Oct 23, 2022
39 Jan 07, 2023
5 Aug 19, 2022
6 Oct 04, 2022
23 Nov 25, 2022
16 Oct 11, 2022
22 Sep 29, 2022
105 Dec 17, 2022
8 Jan 06, 2023
12 Nov 24, 2022
115 Dec 30, 2022