awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Adds timm pretrained backbone to pytorch's FasterRcnn model

Tool cek opsi checkpoint facebook!

Learned Initializations for Optimizing Coordinate-Based Neural Representations

Symbolic Music Generation with Diffusion Models

Converting CPT to bert form for use

TransReID: Transformer-based Object Re-Identification

[ICCV 2021] A Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentation

Global-Local Attention for Emotion Recognition

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression (AAAI2022).

MAterial del programa Misión TIC 2022

Official Pytorch implementation for 2021 ICCV paper "Learning Motion Priors for 4D Human Body Capture in 3D Scenes" and trained models / data

The codes and related files to reproduce the results for Image Similarity Challenge Track 2.

Abstractive opinion summarization system (SelSum) and the largest dataset of Amazon product summaries (AmaSum). EMNLP 2021 conference paper.

A toolkit for developing and comparing reinforcement learning algorithms.

A standard framework for modelling Deep Learning Models for tabular data

Interpolation-based reduced-order models

A very lightweight monitoring system for Raspberry Pi clusters running Kubernetes.

Convert human motion from video to .bvh

unofficial pytorch implement of "Squareplus: A Softplus-Like Algebraic Rectifier"