i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

Data manipulation and transformation for audio signal processing, powered by PyTorch

Implementation of Analyzing and Improving the Image Quality of StyleGAN (StyleGAN 2) in PyTorch

Image Segmentation and Object Detection in Pytorch

My published benchmark for a Kaggle Simulations Competition

An implementation of based on pytorch and mmcv

"Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback"

Code for the ICML 2021 paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

A Dying Light 2 (DL2) PAKFile Utility for Modders and Mod Makers.

This's an implementation of deepmind Visual Interaction Networks paper using pytorch

Embeds a story into a music playlist by sorting the playlist so that the order of the music follows a narrative arc.

LRBoost is a scikit-learn compatible approach to performing linear residual based stacking/boosting.

The 1st Place Solution of the Facebook AI Image Similarity Challenge (ISC21) : Descriptor Track.

CLNTM - Contrastive Learning for Neural Topic Model

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

PyTorch Implementation of Small Lesion Segmentation in Brain MRIs with Subpixel Embedding (ORAL, MICCAIW 2021)

Implementation of hyperparameter optimization/tuning methods for machine learning & deep learning models

Spearmint Bayesian optimization codebase

This is a TensorFlow implementation for C2-Rec

Pytorch Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic

Joint Learning of 3D Shape Retrieval and Deformation, CVPR 2021