Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Neural Style and MSG-Net

Revealing and Protecting Labels in Distributed Training

FasterAI: A library to make smaller and faster models with FastAI.

Source code and data from the RecSys 2020 article "Carousel Personalization in Music Streaming Apps with Contextual Bandits" by W. Bendada, G. Salha and T. Bontempelli

Irrigation controller for Home Assistant

Running Google MoveNet Multipose Tracking models on OpenVINO.

Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wild

Implementation of our paper "Video Playback Rate Perception for Self-supervised Spatio-Temporal Representation Learning".

Mind the Trade-off: Debiasing NLU Models without Degrading the In-distribution Performance

Learning Dynamic Network Using a Reuse Gate Function in Semi-supervised Video Object Segmentation.

PyTorch implementation of saliency map-aided GAN for Auto-demosaic+denosing

SeisComP/SeisBench interface to enable deep-learning (re)picking in SeisComP

Pytorch implementations of Bayes By Backprop, MC Dropout, SGLD, the Local Reparametrization Trick, KF-Laplace, SG-HMC and more

Introduction to CPM

GarmentNets: Category-Level Pose Estimation for Garments via Canonical Space Shape Completion

Context Axial Reverse Attention Network for Small Medical Objects Segmentation

Code for EMNLP 2021 main conference paper "Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification"

Deploy pytorch classification model using Flask and Streamlit

Official PyTorch implementation for FastDPM, a fast sampling algorithm for diffusion probabilistic models

EDPN: Enhanced Deep Pyramid Network for Blurry Image Restoration