Long Expressive Memory (LEM)

Last update: Dec 17, 2022

Overview

Long Expressive Memory for Sequence Modeling

This repository contains the implementation to reproduce the numerical experiments of the paper Long Expressive Memory for Sequence Modeling

Requirements

To setup the environment, install the requirements using python 3.7.10 with

pip install -r requirements.txt

Experiments

This repository contains the codes to reproduce the results of the following experiments for the proposed LEM:

Adding Task
EigenWorms
FitzHugh-Nagumo
Google12 (V2)
Heart rate prediction
noisy CIFAR-10
Permuted Sequential MNIST
PennTree Bank (word- and char-level)
Sequential MNIST

All datasets get either synthetically generated or downloaded automatically, providing a full data pipline for each experiment.
Note that the PTB experiments are based on the open-source tensorflow project LAnguage Modelling Benchmarks (lamb) for tuning and testing Tensorflow language models. In order to reproduce these experiments, please follow the steps explained in the README of the PTB directory.

Results

The results of LEM for each of the experiments are:

Experiment	Result
EigenWorms	92.3% mean test accuracy
FitzHugh-Nagumo	0.002 test L^2 loss
Google12 (V2)	95.7% test accuracy
Heart rate prediction	0.85 test L^2 loss
noisy CIFAR-10	60.5% test accuracy
Permuted Sequential MNIST	96.6% test accuracy
PennTree Bank char-level (single layer)	1.25 test bits-per-character
PennTree Bank word-level (single layer)	72.8 test perplexity
Sequential MNIST	99.5% test accuracy

Long Expressive Memory (LEM)

Related tags

Overview

Long Expressive Memory for Sequence Modeling

Requirements

Experiments

Results

Owner

Konstantin Rusch

UMPNet: Universal Manipulation Policy Network for Articulated Objects

MOOSE (Multi-organ objective segmentation) a data-centric AI solution that generates multilabel organ segmentations to facilitate systemic TB whole-person research

Implementation of the "Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos" paper.

Semi-Supervised Semantic Segmentation via Adaptive Equalization Learning, NeurIPS 2021 (Spotlight)

This repository contains all source code, pre-trained models related to the paper "An Empirical Study on GANs with Margin Cosine Loss and Relativistic Discriminator"

A list of Machine Learning Art Colabs

Codebase for arXiv preprint "NeRF++: Analyzing and Improving Neural Radiance Fields"

dualFace: Two-Stage Drawing Guidance for Freehand Portrait Sketching (CVMJ)

Run object detection model on the Raspberry Pi

Tool for installing and updating MiSTer cores and other files

Pytorch Implementation of Continual Learning With Filter Atom Swapping (ICLR'22 Spolight) Paper

Python scripts to detect faces in Python with the BlazeFace Tensorflow Lite models

Towards Flexible Blind JPEG Artifacts Removal (FBCNN, ICCV 2021)

PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning

Turning SymPy expressions into PyTorch modules.

Another pytorch implementation of FCN (Fully Convolutional Networks)

Runtime type annotations for the shape, dtype etc. of PyTorch Tensors.

Callable PyTrees and filtered JIT/grad transformations => neural networks in JAX.

Code for Contrastive-Geometry Networks for Generalized 3D Pose Transfer

An unreferenced image captioning metric (ACL-21)