Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Last update: Dec 17, 2022

Overview

ADE20k Semantic segmentation with MAE

Getting started

Install the mmsegmentation library and some required packages.

pip install mmcv-full==1.3.0 mmsegmentation==0.11.0
pip install scipy timm==0.3.2

Install apex for mixed-precision training

git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./

Follow the guide in mmseg to prepare the ADE20k dataset.

Fine-tuning for Reproducing Results of MAE ViT-Base

Command:

tools/dist_train.sh configs/mae/upernet_mae_base_12_512_slide_160k_ade20k.py 8 --seed 0  --options model.pretrained=https://dl.fbaipublicfiles.com/mae/pretrain/mae_pretrain_vit_base.pth

Expected results log(paper results: 48.1 mIoU):

+--------+-------+-------+-------+
| Scope  | mIoU  | mAcc  | aAcc  |
+--------+-------+-------+-------+
| global | 48.15 | 58.99 | 83.05 |
+--------+-------+-------+-------+

Evaluation

Command format:

tools/dist_test.sh  <CONFIG_PATH> <CHECKPOINT_PATH> <NUM_GPUS> --eval mIoU

Acknowledgment

This code is built using the mmsegmentation library, Timm library, the Swin repository, XCiT, SETR, BEiT and the MAE repository.

Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Related tags

Overview

ADE20k Semantic segmentation with MAE

Getting started

Fine-tuning for Reproducing Results of MAE ViT-Base

Evaluation

Acknowledgment

Owner

NeROIC: Neural Object Capture and Rendering from Online Image Collections

Project dự đoán giá cổ phiếu bằng thuật toán LSTM gồm: code train và code demo

Unbalanced Feature Transport for Exemplar-based Image Translation (CVPR 2021)

[NeurIPS 2021] Source code for the paper "Qu-ANTI-zation: Exploiting Neural Network Quantization for Achieving Adversarial Outcomes"

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.

A Convolutional Transformer for Keyword Spotting

Companion code for the paper "An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence" (NeurIPS 2021)

Speech Emotion Recognition with Fusion of Acoustic- and Linguistic-Feature-Based Decisions

RipsNet: a general architecture for fast and robust estimation of the persistent homology of point clouds

This repo contains the implementation of YOLOv2 in Keras with Tensorflow backend.

A tutorial on training a DarkNet YOLOv4 model for the CrowdHuman dataset

Proof-Of-Concept Piano-Drums Music AI Model/Implementation

Introducing neural networks to predict stock prices

OneShot Learning-based hotword detection.

Code for Neurips2021 Paper "Topology-Imbalance Learning for Semi-Supervised Node Classification".

The official PyTorch code for 'DER: Dynamically Expandable Representation for Class Incremental Learning' accepted by CVPR2021

QuALITY: Question Answering with Long Input Texts, Yes!

Python Tensorflow 2 scripts for detecting objects of any class in an image without knowing their label.

Code for the paper: Hierarchical Reinforcement Learning With Timed Subgoals, published at NeurIPS 2021

Multi-Task Deep Neural Networks for Natural Language Understanding