Code for "Multi-Time Attention Networks for Irregularly Sampled Time Series", ICLR 2021.

Last update: Dec 17, 2022

Overview

Multi-Time Attention Networks (mTANs)

This repository contains the PyTorch implementation for the paper Multi-Time Attention Networks for Irregularly Sampled Time Series by Satya Narayan Shukla and Benjamin M. Marlin. This work has been accepted at the International Conference on Learning Representations, 2021.

Requirements

The code requires Python 3.7 or later. The file requirements.txt contains the full list of required Python modules.

pip3 install -r requirements.txt

Training and Evaluation

Interpolation Task on Toy Dataset

python3 tan_interpolation.py --niters 5000 --lr 0.0001 --batch-size 128 --rec-hidden 32 --latent-dim 1 --length 20 --enc mtan_rnn --dec mtan_rnn --n 1000  --gen-hidden 50 --save 1 --k-iwae 5 --std 0.01 --norm --learn-emb --kl --seed 0 --num-ref-points 20 --dataset toy

Interpolation Task on PhysioNet Dataset

python3 tan_interpolation.py --niters 500 --lr 0.001 --batch-size 32 --rec-hidden 64 --latent-dim 16 --quantization 0.016  --enc mtan_rnn --dec mtan_rnn --n 8000  --gen-hidden 50 --save 1 --k-iwae 5 --std 0.01 --norm --learn-emb --kl --seed 0 --num-ref-points 64 --dataset physionet --sample-tp 0.9

Classification Task on PhysioNet Dataset (mTAND-Full)

python3 tan_classification.py --alpha 100 --niters 300 --lr 0.0001 --batch-size 50 --rec-hidden 256 --gen-hidden 50 --latent-dim 20 --enc mtan_rnn --dec mtan_rnn --n 8000 --quantization 0.016 --save 1 --classif --norm --kl --learn-emb --k-iwae 1 --dataset physionet

Classification Task on PhysioNet Dataset (mTAND-Enc)

python3 tanenc_classification.py --niters 200 --lr 0.0001 --batch-size 128 --rec-hidden 128 --enc mtan_enc --n 8000 --quantization 0.016 --save 1 --classif --num-heads 1 --learn-emb --dataset physionet --seed 0

Classification Task on MIMIC-III Dataset (mTAND-Full)

python3 tan_classification.py --alpha 5 --niters 300 --lr 0.0001 --batch-size 128 --rec-hidden 256 --gen-hidden 50 --latent-dim 128 --enc mtan_rnn --dec mtan_rnn   --save 1 --classif --norm --learn-emb --k-iwae 1 --dataset mimiciii

For MIMIC-III Dataset, first you need to have an access to the dataset which can be requested here. We follow the data extraction process described here: https://github.com/mlds-lab/interp-net.

Classification Task on MIMIC-III Dataset (mTAND-Enc)

python3 tanenc_classification.py --niters 200 --lr 0.0001 --batch-size 256 --rec-hidden 256 --enc mtan_enc  --quantization 0.016 --save 1 --classif --num-heads 1 --learn-emb --dataset mimiciii --seed 0

Classification Task on Human Activity Dataset (mTAND-Enc)

python3 tanenc_classification.py --niters 1000 --lr 0.001 --batch-size 256 --rec-hidden 512 --enc mtan_enc_activity  --quantization 0.016 --save 1 --classif --num-heads 1 --learn-emb --dataset activity --seed 0 --classify-pertp

Interpolation Results

Interpolation performance on PhysioNet with varying percent of observed time points:

Classification Results

Classification performance on PhysioNet, MIMIC-III and Human activity dataset, and time per epoch in minutes for all the methods on PhysioNet.

Reference

@inproceedings{
shukla2021multitime,
title={Multi-Time Attention Networks for Irregularly Sampled Time Series},
author={Satya Narayan Shukla and Benjamin Marlin},
booktitle={International Conference on Learning Representations},
year={2021},
url={https://openreview.net/forum?id=4c0J6lwQ4_}
}

Code for "Multi-Time Attention Networks for Irregularly Sampled Time Series", ICLR 2021.

Related tags

Overview

Multi-Time Attention Networks (mTANs)

Requirements

Training and Evaluation

Interpolation Results

Classification Results

Reference

Owner

The Laboratory for Robust and Efficient Machine Learning

Evolution Strategies in PyTorch

MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions,spherical coordinates, and intensity

A higher performance pytorch implementation of DeepLab V3 Plus(DeepLab v3+)

Free Book about Deep-Learning approaches for Chess (like AlphaZero, Leela Chess Zero and Stockfish NNUE)

A deep learning library that makes face recognition efficient and effective

Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation

Human Pose estimation with TensorFlow framework

Spatial-Temporal Transformer for Dynamic Scene Graph Generation, ICCV2021

This repo contains the implementation of the algorithm proposed in Off-Belief Learning, ICML 2021.

Airborne Optical Sectioning (AOS) is a wide synthetic-aperture imaging technique

A data-driven approach to quantify the value of classifiers in a machine learning ensemble.

Official code repository for Continual Learning In Environments With Polynomial Mixing Times

Implementation detail for paper "Multi-level colonoscopy malignant tissue detection with adversarial CAC-UNet"

Discord-Protect is a simple discord bot allowing you to have some security on your discord server by ordering a captcha to the user who joins your server.

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2020

Official implementations of PSENet, PAN and PAN++.

Scalable training for dense retrieval models.

a short visualisation script for pyvideo data

Algorithms for outlier, adversarial and drift detection

SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning