Official pytorch code for "APP: Anytime Progressive Pruning"

Last update: Nov 22, 2022

Overview

APP: Anytime Progressive Pruning

Diganta Misra^1,2,3, Bharat Runwal^2,4, Tianlong Chen⁵, Zhangyang Wang⁵, Irina Rish^1,3

¹ Mila - Quebec AI Institute,² Landskape AI,³ UdeM,⁴ IIT-Delhi,⁵ VITA, UT-Austin

Requirements

To create a new conda environment with the dependencies used in this project, do:

conda env create -f app.yml

For running the code on Restricted-Imagenet Dataset, first install the robustness library from here and provide the imagenet_path argument as the path to the imaganet data folder.

Run the Code

Here is an example of running the Anytime Progressive Pruning (APP) on Cifar-10 dataset with 8 megabatches in total:

python main_anytime_train.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --sparsity_level 4.5 \
    --snip_size 0.20 \
    --save_dir c10_r50

One-Shot pruning :

python main_anytime_one.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --sparsity_level 4.5 \
    --snip_size 0.20 \
    --save_dir c10_OSP_r18

Baseline :

python main_anytime_baseline.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --save_dir c10_BASE_r50

Cite:

@misc{misra2022app,
    title={APP: Anytime Progressive Pruning},
    author={Diganta Misra and Bharat Runwal and Tianlong Chen and Zhangyang Wang and Irina Rish},
    year={2022},
    eprint={2204.01640},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

Official pytorch code for "APP: Anytime Progressive Pruning"

Related tags

Overview

APP: Anytime Progressive Pruning

Requirements

Run the Code

Cite:

Owner

Landskape AI

A module that used for encrypt code which includes RSA and AES

Code for the ICCV'21 paper "Context-aware Scene Graph Generation with Seq2Seq Transformers"

QTool: A Low-bit Quantization Toolbox for Deep Neural Networks in Computer Vision

A set of simple scripts to process the Imagenet-1K dataset as TFRecords and make index files for NVIDIA DALI.

GAN-based 3D human pose estimation model for 3DV'17 paper

Github project for Attention-guided Temporal Coherent Video Object Matting.

Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion (CVPR 2021)

A tensorflow/keras implementation of StyleGAN to generate images of new Pokemon.

Single-Stage 6D Object Pose Estimation, CVPR 2020

Vis2Mesh: Efficient Mesh Reconstruction from Unstructured Point Clouds of Large Scenes with Learned Virtual View Visibility ICCV2021

Keras Model Implementation Walkthrough

Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxiv.org/abs/2108.09084).

Recommendation algorithms for large graphs

Official implementation of SIGIR'2021 paper: "Sequential Recommendation with Graph Neural Networks".

Galileo library for large scale graph training by JD

Codes and Data Processing Files for our paper.

SkipGNN: Predicting Molecular Interactions with Skip-Graph Networks (Scientific Reports)

CVPR 2021 - Official code repository for the paper: On Self-Contact and Human Pose.

Partial implementation of ODE-GAN technique from the paper Training Generative Adversarial Networks by Solving Ordinary Differential Equations

A tiny, pedagogical neural network library with a pytorch-like API.