Source for the paper "Universal Activation Function for machine learning"

Last update: Dec 03, 2022

Overview

Universal Activation Function

Tensorflow and Pytorch source code for the paper

Yuen, Brosnan, Minh Tu Hoang, Xiaodai Dong, and Tao Lu. "Universal activation function for machine learning." Scientific reports 11, no. 1 (2021): 1-11.

Getting the code

Requires Docker

Use git to pull this repo

git clone https://github.com/SensorOrgNet/Universal_Activation_Function.git

Running the Tensorflow 2 version

Install CUDA 11.2 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.2.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install tensorflow==2.7.0

Run the MLP with UAF for MNIST dataset

cd   Universal_Activation_Function/tensorflow/
python3   ./mnist_UAF.py

Running the Pytorch version

Install CUDA 11.3 container

docker run --name UAF --gpus all  -v /home/username/UAF/:/workspace  -w /workspace    -it  nvcr.io/nvidia/cuda:11.3.0-cudnn8-devel-ubuntu20.04   bash

Install python

apt update
apt install python3-pip

Install pytorch and pytorch geometric

pip3 install torch==1.10.0+cu113 torchvision==0.11.1+cu113 torchaudio==0.10.0+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
pip3 install torch-scatter -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-sparse -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-cluster -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-spline-conv -f https://data.pyg.org/whl/torch-1.10.0+cu113.html
pip3 install torch-geometric

Run the CNN with UAF for MNIST dataset

cd   Universal_Activation_Function/pytorch/
python3   ./mnist_UAF.py

Run the GCN2 with UAF for CORA dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./gcn2_cora_UAF.py  0

Run the PNA with UAF for ZNC dataset. The fold number is represented by the number at the end

cd   Universal_Activation_Function/pytorch/
python3   ./pna_UAF.py  0

Source for the paper "Universal Activation Function for machine learning"

Related tags

Overview

Universal Activation Function

Getting the code

Running the Tensorflow 2 version

Running the Pytorch version

Owner

CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation

Planar Prior Assisted PatchMatch Multi-View Stereo

implement of SwiftNet:Real-time Video Object Segmentation

Spatially-Adaptive Pixelwise Networks for Fast Image Translation, CVPR 2021

A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution

Official PyTorch implementation of "Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics".

A pytorch-based deep learning framework for multi-modal 2D/3D medical image segmentation

Reference code for the paper "Cross-Camera Convolutional Color Constancy" (ICCV 2021)

All course materials for the Zero to Mastery Deep Learning with TensorFlow course.

領域を指定し、キーを入力することで画像を保存するツールです。クラス分類用のデータセット作成を想定しています。

“英特尔创新大师杯”深度学习挑战赛赛道3：CCKS2021中文NLP地址相关性任务

Code accompanying the paper on "An Empirical Investigation of Domain Generalization with Empirical Risk Minimizers" published at NeurIPS, 2021

Official repository for ABC-GAN

An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi

Luminous is a framework for testing the performance of Embodied AI (EAI) models in indoor tasks.

Paddle pit - Rethinking Spatial Dimensions of Vision Transformers

An implementation of IMLE-Net: An Interpretable Multi-level Multi-channel Model for ECG Classification

Seq2seq - Sequence to Sequence Learning with Keras

Optimizers-visualized - Visualization of different optimizers on local minimas and saddle points.

Code and description for my BSc Project, September 2021

Source for the paper "Universal Activation Function for machine learning"

Related tags

Overview

Universal Activation Function

Getting the code

Running the Tensorflow 2 version

Running the Pytorch version

Owner

CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation

Planar Prior Assisted PatchMatch Multi-View Stereo

implement of SwiftNet:Real-time Video Object Segmentation

Spatially-Adaptive Pixelwise Networks for Fast Image Translation, CVPR 2021

A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution

Official PyTorch implementation of "Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics".

A pytorch-based deep learning framework for multi-modal 2D/3D medical image segmentation

Reference code for the paper "Cross-Camera Convolutional Color Constancy" (ICCV 2021)

All course materials for the Zero to Mastery Deep Learning with TensorFlow course.

領域を指定し、キーを入力することで画像を保存するツールです。クラス分類用のデータセット作成を想定しています。

“英特尔创新大师杯”深度学习挑战赛 赛道3：CCKS2021中文NLP地址相关性任务

Code accompanying the paper on "An Empirical Investigation of Domain Generalization with Empirical Risk Minimizers" published at NeurIPS, 2021

Official repository for ABC-GAN

An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi

Luminous is a framework for testing the performance of Embodied AI (EAI) models in indoor tasks.

Paddle pit - Rethinking Spatial Dimensions of Vision Transformers

An implementation of IMLE-Net: An Interpretable Multi-level Multi-channel Model for ECG Classification

Seq2seq - Sequence to Sequence Learning with Keras

Optimizers-visualized - Visualization of different optimizers on local minimas and saddle points.

Code and description for my BSc Project, September 2021

“英特尔创新大师杯”深度学习挑战赛赛道3：CCKS2021中文NLP地址相关性任务