SCNet: Learning Semantic Correspondence

Related tags

Deep LearningSCNet
Overview

SCNet Code

Region matching code is contributed by Kai Han ([email protected]).

Dense matching code is contributed by Rafael S. Rezende ([email protected]).

This code is written in MATLAB, and implements the SCNet[1]. For the dataset, see our project page: http://www.di.ens.fr/willow/research/scnet.

Install Dependencies

Codes

SCNet_Matconvnet

Additional Matconvnet modules implemented for SCNet. These code should be copied into matconvnet/matlab/ folder.

SCNet

This is the primary net work training and testing code.

  • SCNet_A_init.m, SCNet_AG_init.m, SCNet_AGplus_init.m: initialize the SCNet_A, SCNet_AG, SCNet_AG+.

  • SCNet_A.m, SCNet_AG.m, SCNet_AGplus.m: train SCNet_A, SCNet_AG, SCNet_AG+.

  • eva_PCR_mIoU_SCNet_A.m, eva_PCR_mIoU_SCNet_AG.m, eva_PCR_mIoU_SCNet_AGplus.m: evaluate the trained nets.

  • eva_PCR_mIoU_ImageNet_SCNet_A.m, eva_PCR_mIoU_ImageNet_SCNet_AG.m, eva_PCR_mIoU_ImageNet_SCNet_AGplus.m: evaluate SCNets with ImageNet pretrained parameters, i.e., SCNets without training.

SCNet_Baselines

Comparison code for our SCNet features and HOG features with NAM, PHM and LOM in Proposal Flow [2, 3].

  • NAM_HOG_eva.m, PHM_HOG_eva.m, LOM_HOG_eva.m: evaluate NAM, PHM, and LOM with HOG features.

  • NAM_SCNet_eva.m, PHM_SCNet_eva.m, LOM_SCNet_eva.m: evaluate NAM, PHM, and LOM with learned SCNet features.

  • HOG_SCNet_AG_eva.m: replace the learned SCNet feature by HOG feature in SCNet_AG model.

Data

We used PF-PASCAL, PF-WILLOW, PASCAL Parts and CUB data sets and follows Proposal Flow[2, 3] to generate our trainging data.

Triaining data preparation code is put in PF-PASCAL-code folder.

Notes

  • The code is provided for academic use only. Use of the code in any commercial or industrial related activities is prohibited.
  • If you use our code or dataset, please cite the paper.
@InProceedings{han2017scnet,
author = {Kai Han and Rafael S. Rezende and Bumsub Ham and Kwan-Yee K. Wong and Minsu Cho and Cordelia Schmid and Jean Ponce},
title = {SCNet: Learning Semantic Correspondence},
booktitle = {International Conference on Computer Vision (ICCV)},
year = {2017}
}

References

[1] Kai Han, Rafael S. Rezende, Bumsub Ham, Kwan-Yee K. Wong, Minsu Cho, Cordelia Schmid, Jean Ponce, "SCNet: Learning Semantic Correspondence", International Conference on Computer Vision (ICCV), 2017.

[2] Bumsub Ham, Minsu Cho, Cordelia Schmid, Jean Ponce, "Proposal Flow: Semantic Correspondences from Object Proposals", IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2017

[3] Bumsub Ham, Minsu Cho, Cordelia Schmid, Jean Ponce, "Proposal Flow", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Owner
Kai Han
Visual Geometry Group (VGG)
Kai Han
Picasso: a methods for embedding points in 2D in a way that respects distances while fitting a user-specified shape.

Picasso Code to generate Picasso embeddings of any input matrix. Picasso maps the points of an input matrix to user-defined, n-dimensional shape coord

Pachter Lab 45 Dec 23, 2022
TEDSummary is a speech summary corpus. It includes TED talks subtitle (Document), Title-Detail (Summary), speaker name (Meta info), MP4 URL, and utterance id

TEDSummary is a speech summary corpus. It includes TED talks subtitle (Document), Title-Detail (Summary), speaker name (Meta info), MP4 URL

3 Dec 26, 2022
[CVPR 2021 Oral] Variational Relational Point Completion Network

VRCNet: Variational Relational Point Completion Network This repository contains the PyTorch implementation of the paper: Variational Relational Point

PL 121 Dec 12, 2022
Consensus score for tripadvisor

ContripScore ContripScore is essentially a score that combines an Internet platform rating and a consensus rating from sentiment analysis (For instanc

Pepe 1 Jan 13, 2022
PyTorch implementation of Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy

Anomaly Transformer in PyTorch This is an implementation of Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. This pape

spencerbraun 160 Dec 19, 2022
Implementation of "Fast and Flexible Temporal Point Processes with Triangular Maps" (Oral @ NeurIPS 2020)

Fast and Flexible Temporal Point Processes with Triangular Maps This repository includes a reference implementation of the algorithms described in "Fa

Oleksandr Shchur 20 Dec 02, 2022
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Microsoft 8.4k Jan 01, 2023
A real-time approach for mapping all human pixels of 2D RGB images to a 3D surface-based model of the body

DensePose: Dense Human Pose Estimation In The Wild Rıza Alp Güler, Natalia Neverova, Iasonas Kokkinos [densepose.org] [arXiv] [BibTeX] Dense human pos

Meta Research 6.4k Jan 01, 2023
Repository for GNSS-based position estimation using a Deep Neural Network

Code repository accompanying our work on 'Improving GNSS Positioning using Neural Network-based Corrections'. In this paper, we present a Deep Neural

32 Dec 13, 2022
Normalization Calibration (NorCal) for Long-Tailed Object Detection and Instance Segmentation

NorCal Normalization Calibration (NorCal) for Long-Tailed Object Detection and Instance Segmentation On Model Calibration for Long-Tailed Object Detec

Tai-Yu (Daniel) Pan 24 Dec 25, 2022
Bringing sanity to world of messed-up data

Sanitize sanitize is a Python module for making sure various things (e.g. HTML) are safe to use. It was originally written by Mark Pilgrim and is dist

Alireza Savand 63 Oct 26, 2021
Model Zoo for MindSpore

Welcome to the Model Zoo for MindSpore In order to facilitate developers to enjoy the benefits of MindSpore framework, we will continue to add typical

MindSpore 226 Jan 07, 2023
Code for "LoRA: Low-Rank Adaptation of Large Language Models"

LoRA: Low-Rank Adaptation of Large Language Models This repo contains the implementation of LoRA in GPT-2 and steps to replicate the results in our re

Microsoft 394 Jan 08, 2023
A collection of IPython notebooks covering various topics.

ipython-notebooks This repo contains various IPython notebooks I've created to experiment with libraries and work through exercises, and explore subje

John Wittenauer 2.6k Jan 01, 2023
Use VITS and Opencpop to develop singing voice synthesis; Maybe it will VISinger.

Init Use VITS and Opencpop to develop singing voice synthesis; Maybe it will VISinger. 本项目基于 https://github.com/jaywalnut310/vits https://github.com/S

AmorTX 107 Dec 23, 2022
The code repository for "RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection" (ACM MM'21)

RCNet: Reverse Feature Pyramid and Cross-scale Shift Network for Object Detection (ACM MM'21) By Zhuofan Zong, Qianggang Cao, Biao Leng Introduction F

TempleX 9 Jul 30, 2022
Sparse R-CNN: End-to-End Object Detection with Learnable Proposals, CVPR2021

End-to-End Object Detection with Learnable Proposal, CVPR2021

Peize Sun 1.2k Dec 27, 2022
Lightweight mmm - Lightweight (Bayesian) Media Mix Model

Lightweight (Bayesian) Media Mix Model This is not an official Google product. L

Google 342 Jan 03, 2023
Visual Question Answering in Pytorch

Visual Question Answering in pytorch /!\ New version of pytorch for VQA available here: https://github.com/Cadene/block.bootstrap.pytorch This repo wa

Remi 672 Jan 01, 2023
TuckER: Tensor Factorization for Knowledge Graph Completion

TuckER: Tensor Factorization for Knowledge Graph Completion This codebase contains PyTorch implementation of the paper: TuckER: Tensor Factorization f

Ivana Balazevic 296 Dec 06, 2022