Long Expressive Memory (LEM)

Last update: Dec 17, 2022

Overview

Long Expressive Memory for Sequence Modeling

This repository contains the implementation to reproduce the numerical experiments of the paper Long Expressive Memory for Sequence Modeling

Requirements

To setup the environment, install the requirements using python 3.7.10 with

pip install -r requirements.txt

Experiments

This repository contains the codes to reproduce the results of the following experiments for the proposed LEM:

Adding Task
EigenWorms
FitzHugh-Nagumo
Google12 (V2)
Heart rate prediction
noisy CIFAR-10
Permuted Sequential MNIST
PennTree Bank (word- and char-level)
Sequential MNIST

All datasets get either synthetically generated or downloaded automatically, providing a full data pipline for each experiment.
Note that the PTB experiments are based on the open-source tensorflow project LAnguage Modelling Benchmarks (lamb) for tuning and testing Tensorflow language models. In order to reproduce these experiments, please follow the steps explained in the README of the PTB directory.

Results

The results of LEM for each of the experiments are:

Experiment	Result
EigenWorms	92.3% mean test accuracy
FitzHugh-Nagumo	0.002 test L^2 loss
Google12 (V2)	95.7% test accuracy
Heart rate prediction	0.85 test L^2 loss
noisy CIFAR-10	60.5% test accuracy
Permuted Sequential MNIST	96.6% test accuracy
PennTree Bank char-level (single layer)	1.25 test bits-per-character
PennTree Bank word-level (single layer)	72.8 test perplexity
Sequential MNIST	99.5% test accuracy

Long Expressive Memory (LEM)

Related tags

Overview

Long Expressive Memory for Sequence Modeling

Requirements

Experiments

Results

Owner

Konstantin Rusch

A robust pointcloud registration pipeline based on correlation.

Code for "Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency" paper

This is project is the implementation of the DeepShift: Towards Multiplication-Less Neural Networks paper

Using OpenAI's CLIP to upscale and enhance images

Supplemental Code for "ImpressionNet :A Multi view Approach to Predict Socio Facial Impressions"

SuperSonic, a new open-source framework to allow compiler developers to integrate RL into compilers easily, regardless of their RL expertise

NALSM: Neuron-Astrocyte Liquid State Machine

Pytorch implementation of "MOSNet: Deep Learning based Objective Assessment for Voice Conversion"

git《Joint Entity and Relation Extraction with Set Prediction Networks》(2020) GitHub:

Pytorch Implementation of Interaction Networks for Learning about Objects, Relations and Physics

(Arxiv 2021) NeRF--: Neural Radiance Fields Without Known Camera Parameters

Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLPv2, RaftMLP, ConvMLP, ConvMixer in Jittor and PyTorch.

Meshed-Memory Transformer for Image Captioning. CVPR 2020

Linescanning - Package for (pre)processing of anatomical and (linescanning) fMRI data

A Python script that creates subtitles of a given length from text paragraphs that can be easily imported into any Video Editing software such as FinalCut Pro for further adjustments.

HyperPose is a library for building high-performance custom pose estimation applications.

Making a music video with Wav2CLIP and VQGAN-CLIP

DeepOBS: A Deep Learning Optimizer Benchmark Suite

Random Forests for Regression with Missing Entries

Yas CRNN model training - Yet Another Genshin Impact Scanner