Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Last update: Nov 25, 2022

Related tags

Deep Learning CMSF

Overview

CMSF

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Requirements

Python >= 3.7.6
PyTorch >= 1.4
torchvision >= 0.5.0
faiss-gpu >= 1.6.1

Install PyTorch and ImageNet dataset following the official PyTorch ImageNet training code. We used Python 3.7 for our experiments.

Install PyTorch (pytorch.org)

To run NN and CMSF-KM, you require to install FAISS.

FAISS:

Install FAISS (https://github.com/facebookresearch/faiss/blob/master/INSTALL.md)

Training Self-Supservised CMSF-KM

python self_supervised/train_msf_km.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --num_clusters 50000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Self-Supservised CMSF-2Q

python self_supervised/train_msf_2q.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --topkp 5 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Supservised

Following command can be used to train the CMSF(Supervised Learning)

python supervised/train_sup_msf.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 10 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

License

This project is under the MIT license.

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Related tags

Overview

CMSF

Requirements

Training Self-Supservised CMSF-KM

Training Self-Supservised CMSF-2Q

Training Supservised

License

Owner

Provide partial dates and retain the date precision through processing

Cortex-compatible model server for Python and TensorFlow

Code for "Adversarial Training for a Hybrid Approach to Aspect-Based Sentiment Analysis

Supervised Contrastive Learning for Product Matching

Learning Super-Features for Image Retrieval

CycleTransGAN-EVC: A CycleGAN-based Emotional Voice Conversion Model with Transformer

Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks

Leaderboard, taxonomy, and curated list of few-shot object detection papers.

Propose a principled and practically effective framework for unsupervised accuracy estimation and error detection tasks with theoretical analysis and state-of-the-art performance.

A denoising autoencoder + adversarial losses and attention mechanisms for face swapping.

A Tensorflow implementation of BicycleGAN.

Motion and Shape Capture from Sparse Markers

Pytorch implement of 'Unmixing based PAN guided fusion network for hyperspectral imagery'

MVP Benchmark for Multi-View Partial Point Cloud Completion and Registration

This repo is to be freely used by ML devs to check the GAN performances without coding from scratch.

3D dataset of humans Manipulating Objects in-the-Wild (MOW)

Cancer-and-Tumor-Detection-Using-Inception-model - In this repo i am gonna show you how i did cancer/tumor detection in lungs using deep neural networks, specifically here the Inception model by google.

This repository contains the code for Direct Molecular Conformation Generation (DMCG).

An introduction to bioimage analysis - http://bioimagebook.github.io

Implementation for the paper: Invertible Denoising Network: A Light Solution for Real Noise Removal (CVPR2021).