A Machine Teaching Framework for Scalable Recognition

Last update: Dec 08, 2021

Related tags

Overview

MEMORABLE

This repository contains the source code accompanying our ICCV 2021 paper.

A Machine Teaching Framework for Scalable Recognition
Pei Wang, Nuno Vasconcelos.
In ICCV, 2021.

@InProceedings{wang2021gradient,
author = {Wang, Pei and Vasconcelos, Nuno},
title = {A Machine Teaching Framework for Scalable Recognition},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021}
}

Requirements

The project was implemented and tested in Python 3.5 and Pytorch 1.0. Other versions should work after minor modification.
NVIDIA GPU and cuDNN are required to have fast speeds. For now, CUDA 8.0 with cuDNN 6.0.20 has been tested. The other versions should be working.

Datasets

Butterflies and Chinese Characters, Gull are used. Please organize them as below after download,

datasets
|_ butterflies_crop
  |_ images
    |_ Viceroy
    |_ ...
|_ chinese_chars
  |_ images
    |_ grass
    |_ ...
|_ CUBgull
  |_ images
    |_ CaliforniaGull
    |_ ...

Implementation details

To generate counterfactual explanations

get_all_CE_butterflies.py
get_all_CE_gull.py

by SimCLR model

get_all_CE_butterflies_simclr.py
get_all_CE_gull_simclr.py

To generate teaching images and explanations

train_butterflies_CMaxGrad.py
train_gull_CMaxGrad.py

by SimCLR model

train_butterflies_CMaxGrad_simclr.py
train_gull_CMaxGrad_simclr.py

For the SimCLR, we used repo for training. Thanks for their open-source. For standard model, we trained by

train_butterflies_resnet18.py
train_gull_resnet18_linear.py

For questions, feel free to reach out

Pei Wang: [email protected]

A Machine Teaching Framework for Scalable Recognition

Related tags

Overview

MEMORABLE

Requirements

Datasets

Implementation details

To generate counterfactual explanations

To generate teaching images and explanations

Owner

The code is the training example of AAAI2022 Security AI Challenger Program Phase 8: Data Centric Robot Learning on ML models.

Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection

Scalable, event-driven, deep-learning-friendly backtesting library

Hand gesture recognition model that can be used as a remote control for a smart tv.

Danfeng Hong, Lianru Gao, Jing Yao, Bing Zhang, Antonio Plaza, Jocelyn Chanussot. Graph Convolutional Networks for Hyperspectral Image Classification, IEEE TGRS, 2021.

This repo provides code for QB-Norm (Cross Modal Retrieval with Querybank Normalisation)

PyTorch Implementation of PortaSpeech: Portable and High-Quality Generative Text-to-Speech

Notebooks, slides and dataset of the CorrelAid Machine Learning Winter School

Computationally Efficient Optimization of Plackett-Luce Ranking Models for Relevance and Fairness

Official implementation of Rethinking Graph Neural Architecture Search from Message-passing (CVPR2021)

PyTorch Implementation of Vector Quantized Variational AutoEncoders.

[CVPR 2021] Involution: Inverting the Inherence of Convolution for Visual Recognition, a brand new neural operator

Novel and high-performance medical image classification pipelines are heavily utilizing ensemble learning strategies

Building a real-time environment using webcam frame division in OpenCV and classify cropped images using a fine-tuned vision transformers on hybryd datasets samples for facial emotion recognition.

BESS: Balanced Evolutionary Semi-Stacking for Disease Detection via Partially Labeled Imbalanced Tongue Data

Code to reproduce the results for Compositional Attention

Official implementation for ICDAR 2021 paper "Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer"

HyperaPy: An automatic hyperparameter optimization framework ⚡🚀

Real-Time SLAM for Monocular, Stereo and RGB-D Cameras, with Loop Detection and Relocalization Capabilities

RAANet: Range-Aware Attention Network for LiDAR-based 3D Object Detection with Auxiliary Density Level Estimation