TorchDistiller - a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

Last update: Dec 03, 2022

Related tags

Deep Learning TorchDistiller

Overview

TorchDistiller

This project is a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

Collection papers and codebase

Semantic Segmentation

Structured Knowledge Distillation for Semantic Segmentation, CVPR2019 [paper] [code]
Intra-class Feature Variation Distillation for Semantic Segmentation, ECCV2020 [paper] [code]
Channel-wise Knowledge Distillation for Dense Prediction, ICCV2021 [paper] [code]
Knowledge Distillation based on MMsegmentation [code]

Object Detection and Instance Segmentation

Knowledge Distillation based on MMdetection [code]
Knowledge Distillation based on Adet [code]

Update History

2021.08.20 Release the code for channel-wise distillation for semantic segmentation

We are integrating more of our work and other great studies into this project.

TO DO LIST

Distillation on FCOS
Distillation on CondInst

Contribute

To contribute, PR is appreciated and suggestions are welcome to discuss with.

TorchDistiller - a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

Related tags

Overview

TorchDistiller

Collection papers and codebase

Semantic Segmentation

Object Detection and Instance Segmentation

Update History

TO DO LIST

Contribute

Owner

yifan liu

CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields

Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting

1st place solution in CCF BDCI 2021 ULSEG challenge

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

Semantic graph parser based on Categorial grammars

The official code for PRIMER: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization

On the Adversarial Robustness of Visual Transformer

A platform to display the carbon neutralization information for researchers, decision-makers, and other participants in the community.

Data visualization app for H&M competition in kaggle

Learning from Synthetic Data with Fine-grained Attributes for Person Re-Identification

This repository is dedicated to developing and maintaining code for experiments with wide neural networks.

TextureGAN in Pytorch

NitroFE is a Python feature engineering engine which provides a variety of modules designed to internally save past dependent values for providing continuous calculation.

Deep Learning as a Cloud API Service.

A Gura parser implementation for Python

A model that attempts to learn and benefit from data collected on card counting.

This provides the R code and data to replicate results in "The USS Trustee’s risky strategy"

Minimal PyTorch implementation of Generative Latent Optimization from the paper "Optimizing the Latent Space of Generative Networks"

Streaming over lightweight data transformations

The first machine learning framework that encourages learning ML concepts instead of memorizing class functions.