PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

ARM-Net: Adaptive Relation Modeling Network for Structured Data

This repository contains our PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data. We also provide the implementation of relevant baseline models for structured (tabular) data learning.

Our lightweight framework for structured data analytics implemented in Singa can be found in our project site.

Benchmark Dataset

Baseline Model

Model	Code	Reference
Logistic Regression	LR, lr.py
Factorization Machine	FM, fm.py	S Rendle, Factorization Machines, 2010.
Attentional Factorization Machine	AFM, afm.py	J Xiao, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks, 2017.
Higher-Order Factorization Machines	HOFM, hofm.py	M Blondel, et al. Higher-Order Factorization Machines, 2016.
Deep Neural Network	DNN, dnn.py
Graph Convolutional Networks	GCN, gcn.py	T Kipf, et al. Semi-Supervised Classification with Graph Convolutional Networks, 2016.
Graph Convolutional Networks	GAT, gat.py	P Veličković, et al. Graph Attention Networks, 2017.
Wide&Deep	Wide&Deep, wd.py	HT Cheng, et al. Wide & Deep Learning for Recommender Systems, 2016.
Product Neural Network	IPNN/KPNN, pnn.py	Y Qu, et al. Product-based Neural Networks for User Response Prediction, 2016.
Neural Factorization Machine	NFM, nfm.py	X He and TS Chua, Neural Factorization Machines for Sparse Predictive Analytics, 2017.
DeepFM	DeepFM, dfm.py	H Guo, et al. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction, 2017.
Deep & Cross Network	DCN/DCN+, dcn.py	R Wang, et al. Deep & Cross Network for Ad Click Predictions, 2017.
Gated Linear Unit	SA_GLU, sa_glu.py	Y N. Dauphin, et al. Language Modeling with Gated Convolutional Networks, 2017
xDeepFM	CIN/xDeepFM, xdfm.py	J Lian, et al. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, 2018.
Context-Aware Self-Attention Network	GC_ARM, gc_arm.py	B Yang, et al. Context-Aware Self-Attention Networks, 2019
AFN	AFN/AFN+, afn.py	W Cheng, et al. Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions, 2020.
ARM-Net	ARM-Net/ARM-Net+, armnet.py	S Cai, et al. ARM-Net: Adaptive Relation Modeling Network for Structured Data, 2021.

Citation

If you use our code in your research, please kindly cite:

@inproceedings{DBLP:conf/sigmod/CaiZ0JOZ21,
  author    = {Shaofeng Cai and
               Kaiping Zheng and
               Gang Chen and
               H. V. Jagadish and
               Beng Chin Ooi and
               Meihui Zhang},
  title     = {ARM-Net: Adaptive Relation Modeling Network for Structured Data},
  booktitle = {{SIGMOD} '21: International Conference on Management of Data, Virtual
               Event, China, June 20-25, 2021},
  pages     = {207--220},
  publisher = {{ACM}},
  year      = {2021},
}

Contact

To ask questions or report issues, you can directly drop us an email.

PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

Related tags

Overview

ARM-Net: Adaptive Relation Modeling Network for Structured Data

Benchmark Dataset

Baseline Model

Citation

Contact

Owner

Sarus implementation of classical ML models. The models are implemented using the Keras API of tensorflow 2. Vizualization are implemented and can be seen in tensorboard.

Learning kernels to maximize the power of MMD tests

Tensorflow 2 implementation of the paper: Learning and Evaluating Representations for Deep One-class Classification published at ICLR 2021

Semi-supervised Transfer Learning for Image Rain Removal. In CVPR 2019.

Implements pytorch code for the Accelerated SGD algorithm.

Code for "Reconstructing 3D Human Pose by Watching Humans in the Mirror", CVPR 2021 oral

This is a re-implementation of TransGAN: Two Pure Transformers Can Make One Strong GAN (CVPR 2021) in PyTorch.

Advanced Signal Processing Notebooks and Tutorials

The official repository for "Revealing unforeseen diagnostic image features with deep learning by detecting cardiovascular diseases from apical four-chamber ultrasounds"

When are Iterative GPs Numerically Accurate?

Reinforcement Learning for Portfolio Management

Semi-supervised Implicit Scene Completion from Sparse LiDAR

The repo contains the code to train and evaluate a system which extracts relations and explanations from dialogue.

Residual Pathway Priors for Soft Equivariance Constraints

Implementation of Deep Deterministic Policy Gradiet Algorithm in Tensorflow

Social Fabric: Tubelet Compositions for Video Relation Detection

A collection of awesome resources image-to-image translation.

Collection of NLP model explanations and accompanying analysis tools

[ICCV 2021] Official PyTorch implementation for Deep Relational Metric Learning.

🏃‍♀️ A curated list about human motion capture, analysis and synthesis.