Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Large-scale language modeling tutorials with PyTorch

The project is an official implementation of our paper "3D Human Pose Estimation with Spatial and Temporal Transformers".

Based on the paper "Geometry-aware Instance-reweighted Adversarial Training" ICLR 2021 oral

The code for "Deep Level Set for Box-supervised Instance Segmentation in Aerial Images".

Writeups for the challenges from DownUnderCTF 2021

RINDNet: Edge Detection for Discontinuity in Reflectance, Illumination, Normal and Depth, in ICCV 2021 (oral)

Unofficial implementation of "Coordinate Attention for Efficient Mobile Network Design"

A curated list of awesome Model-Based RL resources

Official implementation of the NeurIPS'21 paper 'Conditional Generation Using Polynomial Expansions'.

WORD: Revisiting Organs Segmentation in the Whole Abdominal Region

Reference code for the paper "Cross-Camera Convolutional Color Constancy" (ICCV 2021)

In the AI for TSP competition we try to solve optimization problems using machine learning.

Code for "Steerable Pyramid Transform Enables Robust Left Ventricle Quantification"

An efficient and effective learning to rank algorithm by mining information across ranking candidates. This repository contains the tensorflow implementation of SERank model. The code is developed based on TF-Ranking.

Arxiv harvester - Poor man's simple harvester for arXiv resources

[CVPR 2021] Teachers Do More Than Teach: Compressing Image-to-Image Models (CAT)

A general 3D Object Detection codebase in PyTorch.

This repository contains code to run experiments in the paper "Signal Strength and Noise Drive Feature Preference in CNN Image Classifiers."

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

FFCV: Fast Forward Computer Vision (and other ML workloads!)