Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

An Ensemble of CNN (Python 3.5.1 Tensorflow 1.3 numpy 1.13)

Distributed Arcface Training in Pytorch

This package implements the algorithms introduced in Smucler, Sapienza, and Rotnitzky (2020) to compute optimal adjustment sets in causal graphical models.

An ML & Correlation platform for transforming disparate data points of interest into usable intelligence.

This dlib-based facial login system

Reporting and Visualization for Hazardous Events

Implementations of LSTM: A Search Space Odyssey variants and their training results on the PTB dataset.

Implement some metaheuristics and cost functions

Revisiting, benchmarking, and refining Heterogeneous Graph Neural Networks.

Tilted Empirical Risk Minimization (ICLR '21)

MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification

Code for "CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Clouds" @ICRA2021

Pytorch Lightning Distributed Accelerators using Ray

Provide partial dates and retain the date precision through processing

PyQt6 configuration in yaml format providing the most simple script.

A distributed, plug-n-play algorithm for multi-robot applications with a priori non-computable objective functions

Epidemiology analysis package

Jupyter Dock is a set of Jupyter Notebooks for performing molecular docking protocols interactively, as well as visualizing, converting file formats and analyzing the results.

Tutoriais publicados nas nossas redes sociais para obtenção de dados, análises simples e outras tarefas relevantes no mercado financeiro.

Modular Gaussian Processes