Object-Centric Learning with Slot Attention

Last update: Jan 02, 2023

Related tags

Overview

Slot Attention

This is a re-implementation of "Object-Centric Learning with Slot Attention" in PyTorch (https://arxiv.org/abs/2006.15055).

Requirements

Poetry
Python >= 3.8
PyTorch >= 1.7.1
Pytorch Lightning >= 1.1.4
CUDA enabled computing device

Note: the model was run using a Nvidia Tesla V100 16GB GPU.

Getting Started

Run run.sh to get started. This script will install the dependencies, download the CLEVR dataset and run the model.

Usage

python slot_attention/train.py

Modify SlotAttentionParams in slot_attention/train.py to modify the hyperparameters. See slot_attenion/params.py for the default hyperparamters.

Logging

To log outputs to wandb, run wandb login YOUR_API_KEY and set is_logging_enabled=True in SlotAttentionParams.

Acknowledgements

Special thanks to the original authors of the paper: Francesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran, Georg Heigold, Jakob Uszkoreit, Alexey Dosovitskiy, and Thomas Kipf.

Owner

Untitled AI

We're investigating the fundamentals of learning across humans and machines in order to create more general machine intelligence.

GitHub Repository

A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training quantization (Weight Quantization, Integer Quantization, Full Integer Quantization, Float16 Quantization), Quantization-aware training. TensorFlow Lite. OpenVINO. CoreML. TensorFlow.js. TF-TRT. MediaPipe. ONNX. [.tflite,.h5,.pb,saved_model,tfjs,tftrt,mlmodel,.xml/.bin, .onnx]

PINTO_model_zoo Please read the contents of the LICENSE file located directly under each folder before using the model. My model conversion scripts ar

2.4k Jan 05, 2023

Neural Oblivious Decision Ensembles

Neural Oblivious Decision Ensembles A supplementary code for anonymous ICLR 2020 submission. What does it do? It learns deep ensembles of oblivious di

25 Sep 21, 2022

A program to recognize fruits on pictures or videos using yolov5

Yolov5 Fruits Detector Requirements Either Linux or Windows. We recommend Linux for better performance. Python 3.6+ and PyTorch 1.7+. Installation To

30 Jan 06, 2023

Reinforcement Learning via Supervised Learning

Reinforcement Learning via Supervised Learning Installation Run pip install -e . in an environment with Python = 3.7.0, 3.9. The code depends on MuJ

49 Nov 28, 2022

Curvlearn, a Tensorflow based non-Euclidean deep learning framework.

English | 简体中文 Why Non-Euclidean Geometry Considering these simple graph structures shown below. Nodes with same color has 2-hop distance whereas 1-ho

123 Dec 12, 2022

OptNet: Differentiable Optimization as a Layer in Neural Networks

OptNet: Differentiable Optimization as a Layer in Neural Networks This repository is by Brandon Amos and J. Zico Kolter and contains the PyTorch sourc

428 Dec 24, 2022

Deep Learning Models for Causal Inference

Extensive tutorials for learning how to build deep learning models for causal inference using selection on observables in Tensorflow 2.

151 Dec 31, 2022

Implementation supporting the ICCV 2017 paper "GANs for Biological Image Synthesis"

GANs for Biological Image Synthesis This codes implements the ICCV-2017 paper "GANs for Biological Image Synthesis". The paper and its supplementary m

95 Nov 25, 2022

UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss

UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss This repository contains the TensorFlow implementation of the paper UnF

270 Nov 06, 2022

Python Assignments for the Deep Learning lectures by Andrew NG on coursera with complete submission for grading capability.

1 Feb 03, 2022

Object-Centric Learning with Slot Attention

Related tags

Overview

Slot Attention

Requirements

Getting Started

Usage

Logging

Acknowledgements

Owner

Untitled AI

Neural Oblivious Decision Ensembles

A program to recognize fruits on pictures or videos using yolov5

Reinforcement Learning via Supervised Learning

Curvlearn, a Tensorflow based non-Euclidean deep learning framework.

OptNet: Differentiable Optimization as a Layer in Neural Networks

Deep Learning Models for Causal Inference

Implementation supporting the ICCV 2017 paper "GANs for Biological Image Synthesis"

UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss

Python Assignments for the Deep Learning lectures by Andrew NG on coursera with complete submission for grading capability.

Clean and readable code for Decision Transformer: Reinforcement Learning via Sequence Modeling

Implement A3C for Mujoco gym envs

某学校选课系统GIF验证码数据集 + Baseline模型 + 上下游相关工具

PyTorch implementation of the paper: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Features

An OpenAI-Gym Package for Training and Testing Reinforcement Learning algorithms with OpenSim Models

SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs

A more easy-to-use implementation of KPConv based on PyTorch.

Deep learning image registration library for PyTorch

Convex optimization for fun and profit.

WRENCH: Weak supeRvision bENCHmark