Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

MILK: Machine Learning Toolkit

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

😊 Python module for face feature changing

Automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azure

Table-Extractor 表格抽取

This is a simple backtesting framework to help you test your crypto currency trading. It includes a way to download and store historical crypto data and to execute a trading strategy.

A Pytorch implementation of "LegoNet: Efficient Convolutional Neural Networks with Lego Filters" (ICML 2019).

Does Pretraining for Summarization Reuqire Knowledge Transfer?

Code For TDEER: An Efficient Translating Decoding Schema for Joint Extraction of Entities and Relations (EMNLP2021)

Stock-Prediction - prediction of stock market movements using sentiment analysis and deep learning.

Applicator Kit for Modo allow you to apply Apple ARKit Face Tracking data from your iPhone or iPad to your characters in Modo.

Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network"

OBBDetection: an oriented object detection toolbox modified from MMdetection

A Fast and Accurate One-Stage Approach to Visual Grounding, ICCV 2019 (Oral)

Automatic Idiomatic Expression Detection

Implementation of paper "Self-supervised Learning on Graphs:Deep Insights and New Directions"

UltraGCN: An Ultra Simplification of Graph Convolutional Networks for Recommendation

Code for "The Box Size Confidence Bias Harms Your Object Detector"

An implementation of EWC with PyTorch

Pyeventbus: a publish/subscribe event bus