Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

Official code for "Towards An End-to-End Framework for Flow-Guided Video Inpainting" (CVPR2022)

SCU OlympicsRunning Baseline

Pytorch implementation of our method for regularizing nerual radiance fields for few-shot neural volume rendering.

A weakly-supervised scene graph generation codebase. The implementation of our CVPR2021 paper ``Linguistic Structures as Weak Supervision for Visual Scene Graph Generation''

Codes accompanying the paper "Learning Nearly Decomposable Value Functions with Communication Minimization" (ICLR 2020)

Invariant Causal Prediction for Block MDPs

ByteTrack with ReID module following the paradigm of FairMOT, tracking strategy is borrowed from FairMOT/JDE.

Official Implementation of LARGE: Latent-Based Regression through GAN Semantics

TAug :: Time Series Data Augmentation using Deep Generative Models

Multi-modal Vision Transformers Excel at Class-agnostic Object Detection

Vehicles Counting using YOLOv4 + DeepSORT + Flask + Ngrok

Companion code for the paper "Meta-Learning the Search Distribution of Black-Box Random Search Based Adversarial Attacks" by Yatsura et al.

Match SafeGraph POIs with Data collected through a cultural resource survey in Washington DC.

Tools for computational pathology

Official pytorch implementation of paper "Image-to-image Translation via Hierarchical Style Disentanglement".

A new benchmark for Icon Question Answering (IconQA) and a large-scale icon dataset Icon645.

Code for the paper "Unsupervised Contrastive Learning of Sound Event Representations", ICASSP 2021.

TensorFlow Implementation of "Show, Attend and Tell"

A framework for joint super-resolution and image synthesis, without requiring real training data

TagLab: an image segmentation tool oriented to marine data analysis