The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

Last update: Oct 23, 2021

Related tags

Deep Learning SCOT

Overview

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

@article{lan2021discobox,
  title={DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision},
  author={Lan, Shiyi and Yu, Zhiding and Choy, Christopher and Radhakrishnan, Subhashree and Liu, Guilin and Zhu, Yuke and Davis, Larry S and Anandkumar, Anima},
  journal={arXiv preprint arXiv:2105.06464},
  year={2021}
}

[ Paper ]

Introduction

This repository is the implementation of evaluating DiscoBox on PF-Pascal dataset.

This implementation is based on SCOT

Installation

Conda environment settings

conda create -n scot python=3.6
conda activate scot

cat /usr/local/cuda/version.txt
conda install pytorch=1.4.0 torchvision cudatoolkit=10.0 -c pytorch (if CUDA 10) 
conda install pytorch=1.4.0 torchvision cudatoolkit=9.0 -c pytorch (if CUDA 9) 

conda install -c anaconda scikit-image
conda install -c anaconda pandas
conda install -c anaconda requests
pip install gluoncv-torch

Pretrained Weights

Download the pretrained weights from this link.

Evaluation

Results on PF-PASCAL with res101:

    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.05
    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.10
    python evaluate_map_CAM.py --dataset pfpascal --thres img --backbone resnet101 --hyperpixel '(2,22,24,25,27,28,29)' --sim OTGeo --exp1 1.0 --exp2 0.5 --eps 0.05 --gpu 0 --classmap 1 --split test --alpha 0.15

All results

Method	Backbone	[email protected]	[email protected]	[email protected]
SCOT	ResNet-101	63.2	85.4	92.8
DiscoBox	ResNet-101	62.7	85.6	93.5

Training

Please look at this link for more details

The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

Related tags

Overview

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

Introduction

Installation

Conda environment settings

Pretrained Weights

Evaluation

All results

Training

Owner

Shiyi Lan

Image transformations designed for Scene Text Recognition (STR) data augmentation. Published at ICCV 2021 Workshop on Interactive Labeling and Data Augmentation for Vision.

A multi-entity Transformer for multi-agent spatiotemporal modeling.

PoolFormer: MetaFormer is Actually What You Need for Vision

Code for the SIGGRAPH 2021 paper "Consistent Depth of Moving Objects in Video".

Official source code of paper 'IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo'

CTRL-C: Camera calibration TRansformer with Line-Classification

PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis

The Generic Manipulation Driver Package - Implements a ROS Interface over the robotics toolbox for Python

An implementation of the BADGE batch active learning algorithm.

HyperaPy: An automatic hyperparameter optimization framework ⚡🚀

You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptors

Pytorch implementation of Depth-conditioned Dynamic Message Propagation forMonocular 3D Object Detection

Adversarial vulnerability of powerful near out-of-distribution detection

Algorithms for outlier, adversarial and drift detection

Libraries, tools and tasks created and used at DeepMind Robotics.

Robust Lane Detection via Expanded Self Attention (WACV 2022)

Full Resolution Residual Networks for Semantic Image Segmentation

Bridging the Gap between Label- and Reference based Synthesis(ICCV 2021)

In this project, we develop a face recognize platform based on MTCNN object-detection netcwork and FaceNet self-supervised network.

2021-MICCAI-Progressively Normalized Self-Attention Network for Video Polyp Segmentation