awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Contrastive Learning for Compact Single Image Dehazing, CVPR2021

PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation

Dynamic Realtime Animation Control

Implementation of Convolutional LSTM in PyTorch.

The source codes for ACL 2021 paper 'BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data'

InterFaceGAN - Interpreting the Latent Space of GANs for Semantic Face Editing

Image based Human Fall Detection

Teaches a student network from the knowledge obtained via training of a larger teacher network

Hi Guys, here I am providing examples, which will help you in Lerarning Python

PyTorch Code for NeurIPS 2021 paper Anti-Backdoor Learning: Training Clean Models on Poisoned Data.

RL-driven agent playing tic-tac-toe on starknet against challengers.

Code for the paper: Hierarchical Reinforcement Learning With Timed Subgoals, published at NeurIPS 2021

An implementation on "Curved-Voxel Clustering for Accurate Segmentation of 3D LiDAR Point Clouds with Real-Time Performance"

Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsing

Vector Quantization, in Pytorch

frida工具的缝合怪

Self-Supervised Image Denoising via Iterative Data Refinement

Locationinfo - A script helps the user to show network information such as ip address

Mortgage-loan-prediction - Show how to perform advanced Analytics and Machine Learning in Python using a full complement of PyData utilities

Deep Learning and Reinforcement Learning Library for Scientists and Engineers 🔥