Self-Supervised Learning

Last update: Dec 14, 2021

Overview

Self-Supervised Learning

Features

self_supervised offers features like

modular framework
support for multi-gpu training using PyTorch Lightning
easy to use and written in a PyTorch like style
supports custom backbone models for self-supervised pre-training

Supported Models

Supported Loss Function

Benchmarks

Currently implemented models and their accuracy on cifar10 and imagenette.

ImageNette

Model	Epochs	Batch Size	Test Accuracy
MoCo	800	256	0.827
SimCLR	800	256	0.847
SimSiam	800	256	0.827
BarlowTwins	800	256	0.801
BYOL	800	256	0.851

Cifar10

Model	Epochs	Batch Size	Test Accuracy
MoCo	200	128	0.83
SimCLR	200	128	0.78
SimSiam	200	128	0.73
BarlowTwins	200	128	0.84
BYOL	200	128	0.85
MoCo	200	512	0.85
SimCLR	200	512	0.83
SimSiam	200	512	0.81
BarlowTwins	200	512	0.78
BYOL	200	512	0.84
MoCo	800	128	0.89
SimCLR	800	128	0.87
SimSiam	800	128	0.80
MoCo	800	512	0.90
SimCLR	800	512	0.89
SimSiam	800	512	0.91

Tutorials

Want to jump to the tutorials and see lightly in action?

Self-Supervised Learning

Related tags

Overview

Self-Supervised Learning

Features

Supported Models

Supported Loss Function

Benchmarks

ImageNette

Cifar10

Tutorials

Further Reading

Owner

Robin

An imperfect information game is a type of game with asymmetric information

The repository offers the official implementation of our BMVC 2021 paper in PyTorch.

Code Repository for The Kaggle Book, Published by Packt Publishing

Source codes for Improved Few-Shot Visual Classification (CVPR 2020), Enhancing Few-Shot Image Classification with Unlabelled Examples

K-Nearest Neighbor in Pytorch

Gems & Holiday Package Prediction

The official re-implementation of the Neurips 2021 paper, "Targeted Neural Dynamical Modeling".

My personal code and solution to the Synacor Challenge from 2012 OSCON.

Implementing DeepMind's Fast Reinforcement Learning paper

Robotics environments

Awesome Remote Sensing Toolkit based on PaddlePaddle.

Localizing Visual Sounds the Hard Way

Reinforcement-learning - Repository of the class assignment questions for the course on reinforcement learning

Code for reproducing experiments in "Improved Training of Wasserstein GANs"

Instant Real-Time Example-Based Style Transfer to Facial Videos

Extracts data from the database for a graph-node and stores it in parquet files

This script scrapes and stores the availability of timeslots for Car Driving Test at all RTA Serivce NSW centres in the state.

The easiest tool for extracting radiomics features and training ML models on them.

CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selection

Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!