Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Last update: May 19, 2022

Related tags

Deep Learning hidden-fold-networks

Overview

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

by Ángel López García-Arias, Masanori Hashimoto, Masato Motomura, and Jaehoon Yu

Accepted at The British Machine Vision Conference (BMVC) 2021.

arXiv link

The code in this repository was originally developed from a fork of hidden-networks.

Requirements

Python 3.6 or higher. CUDA 11.0.
For library requirements see requirements.txt.

Usage

Experiment configurations are defined in yaml files under configs/.
These configurations can be overridden by setting parameters directly through arguments (see args.py).

Example 1: HFN-ResNet50, top-k%=30%, CIFAR100

python3 main.py --config configs/CIFAR100/HFN_ResNet50_3_4.yaml --multigpu 0

Example 2: HFN-ResNet50, top-k%=50%, CIFAR100, 100 epochs

python3 main.py --config configs/CIFAR100/HFN_ResNet50_3_4.yaml --multigpu 0 --top_k=0.5 --epochs 100

Owner

Ángel López García-Arias

AI Computing Research Unit, Tokyo Institute of Technology

GitHub Repository

Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval

BiDR Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval. Requirements torch==

11 Oct 20, 2022

ACV is a python library that provides explanations for any machine learning model or data.

ACV is a python library that provides explanations for any machine learning model or data. It gives local rule-based explanations for any model or data and different Shapley Values for tree-based mod

85 Dec 27, 2022

RADIal is available now! Check the download section

Latest news: RADIal is available now! Check the download section. However, because we are currently working on the data anonymization, we provide for

55 Jan 03, 2023

Equivariant CNNs for the sphere and SO(3) implemented in PyTorch

893 Dec 28, 2022

《Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis》(2021)

Image2Reverb Image2Reverb is an end-to-end neural network that generates plausible audio impulse responses from single images of acoustic environments

48 Nov 27, 2022

Awesome Long-Tailed Learning

Awesome Long-Tailed Learning This repo pays specially attention to the long-tailed distribution, where labels follow a long-tailed or power-law distri

284 Jan 06, 2023

MolRep: A Deep Representation Learning Library for Molecular Property Prediction

MolRep: A Deep Representation Learning Library for Molecular Property Prediction Summary MolRep is a Python package for fairly measuring algorithmic p

83 Dec 24, 2022

Reverse engineering Rosetta 2 in M1 Mac

Project Champollion About this project Rosetta 2 is an emulation mechanism to run the x86_64 applications on Arm-based Apple Silicon with Ahead-Of-Tim

258 Jan 07, 2023

Projects for AI/ML and IoT integration for games and other presented at re:Invent 2021.

Playground4AWS Projects for AI/ML and IoT integration for games and other presented at re:Invent 2021. Architecture Minecraft and Lamps This project i

5 Nov 30, 2022

CoReNet is a technique for joint multi-object 3D reconstruction from a single RGB image.

CoReNet CoReNet is a technique for joint multi-object 3D reconstruction from a single RGB image. It produces coherent reconstructions, where all objec

80 Dec 25, 2022

An experiment on the performance of homemade Q-learning AIs in Agar.io depending on their state representation and available actions

Agar.io_Q-Learning_AI An experiment on the performance of homemade Q-learning AIs in Agar.io depending on their state representation and available act

1 Jun 09, 2022

Brain tumor detection using Convolution-Neural Network (CNN)

Detect and Classify Brain Tumor using CNN. A system performing detection and classification by using Deep Learning Algorithms using Convolution-Neural Network (CNN).

1 Feb 07, 2022

The source code of "SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation", accepted to WACV 2022.

SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation The source code of our work "SIDE: Center-based Stereo 3D Detecto

10 Dec 18, 2022

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)

Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction This is the code for the paper Combining E

69 Dec 26, 2022

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Related tags

Overview

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Requirements

Usage

Example 1: HFN-ResNet50, top-k%=30%, CIFAR100

Example 2: HFN-ResNet50, top-k%=50%, CIFAR100, 100 epochs

Owner

Ángel López García-Arias

Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval

ACV is a python library that provides explanations for any machine learning model or data.

RADIal is available now! Check the download section

Equivariant CNNs for the sphere and SO(3) implemented in PyTorch

《Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis》(2021)

Awesome Long-Tailed Learning

MolRep: A Deep Representation Learning Library for Molecular Property Prediction

Reverse engineering Rosetta 2 in M1 Mac

Projects for AI/ML and IoT integration for games and other presented at re:Invent 2021.

CoReNet is a technique for joint multi-object 3D reconstruction from a single RGB image.

An experiment on the performance of homemade Q-learning AIs in Agar.io depending on their state representation and available actions

Brain tumor detection using Convolution-Neural Network (CNN)

The source code of "SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation", accepted to WACV 2022.

ICNet for Real-Time Semantic Segmentation on High-Resolution Images, ECCV2018

Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy" (ICLR 2022 Spotlight)

Automated Evidence Collection for Fake News Detection

What can linearized neural networks actually say about generalization?

Implementation of Shape Generation and Completion Through Point-Voxel Diffusion

Anchor-free Oriented Proposal Generator for Object Detection

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)