Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Fast and Easy Infinite Neural Networks in Python

Spherical Confidence Learning for Face Recognition, accepted to CVPR2021.

The repo for reproducing Seed-driven Document Ranking for Systematic Reviews: A Reproducibility Study

A set of tools for converting a darknet dataset to COCO format working with YOLOX

TrackFormer: Multi-Object Tracking with Transformers

This package implements the algorithms introduced in Smucler, Sapienza, and Rotnitzky (2020) to compute optimal adjustment sets in causal graphical models.

Graph Robustness Benchmark: A scalable, unified, modular, and reproducible benchmark for evaluating the adversarial robustness of Graph Machine Learning.

PyTorch module to use OpenFace's nn4.small2.v1.t7 model

[ICCV 2021] Official Tensorflow Implementation for "Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutions"

Codebase for INVASE: Instance-wise Variable Selection - 2019 ICLR

Spectralformer: Rethinking hyperspectral image classification with transformers

Image De-raining Using a Conditional Generative Adversarial Network

A library for preparing, training, and evaluating scalable deep learning hybrid recommender systems using PyTorch.

On the model-based stochastic value gradient for continuous reinforcement learning

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Semantic Segmentation.

Multilingual Image Captioning

Manage the availability of workspaces within Frappe/ ERPNext (sidebar) based on user-roles

Ganilla - Official Pytorch implementation of GANILLA

Pytorch implementation for "Large-Scale Long-Tailed Recognition in an Open World" (CVPR 2019 ORAL)

[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links