Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Implementation of the "Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos" paper.

Byte-based multilingual transformer TTS for low-resource/few-shot language adaptation.

Centroid-UNet is deep neural network model to detect centroids from satellite images.

Ontologysim: a Owlready2 library for applied production simulation

First-Order Probabilistic Programming Language

Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

Deep Learning pipeline for motor-imagery classification.

Given a 2D triangle mesh, we could randomly generate cloud points that fill in the triangle mesh

Keras Image Embeddings using Contrastive Loss

Spline is a tool that is capable of running locally as well as part of well known pipelines like Jenkins (Jenkinsfile), Travis CI (.travis.yml) or similar ones.

A Text Attention Network for Spatial Deformation Robust Scene Text Image Super-resolution (CVPR2022)

This project uses Template Matching technique for object detecting by detection of template image over base image.

Estimating Example Difficulty using Variance of Gradients

Label Studio is a multi-type data labeling and annotation tool with standardized output format

PyTorch Implementation for AAAI'21 "Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection"

Asymmetric Bilateral Motion Estimation for Video Frame Interpolation, ICCV2021

Free course that takes you from zero to Reinforcement Learning PRO 🦸🏻‍🦸🏽

An integration of several popular automatic augmentation methods, including OHL (Online Hyper-Parameter Learning for Auto-Augmentation Strategy) and AWS (Improving Auto Augment via Augmentation Wise Weight Sharing) by Sensetime Research.

Control-Robot-Arm-using-PS4-Controller - A Robotic Arm based on Raspberry Pi and Arduino that controlled by PS4 Controller

PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)