PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

ARM-Net: Adaptive Relation Modeling Network for Structured Data

This repository contains our PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data. We also provide the implementation of relevant baseline models for structured (tabular) data learning.

Our lightweight framework for structured data analytics implemented in Singa can be found in our project site.

Benchmark Dataset

Baseline Model

Model	Code	Reference
Logistic Regression	LR, lr.py
Factorization Machine	FM, fm.py	S Rendle, Factorization Machines, 2010.
Attentional Factorization Machine	AFM, afm.py	J Xiao, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks, 2017.
Higher-Order Factorization Machines	HOFM, hofm.py	M Blondel, et al. Higher-Order Factorization Machines, 2016.
Deep Neural Network	DNN, dnn.py
Graph Convolutional Networks	GCN, gcn.py	T Kipf, et al. Semi-Supervised Classification with Graph Convolutional Networks, 2016.
Graph Convolutional Networks	GAT, gat.py	P Veličković, et al. Graph Attention Networks, 2017.
Wide&Deep	Wide&Deep, wd.py	HT Cheng, et al. Wide & Deep Learning for Recommender Systems, 2016.
Product Neural Network	IPNN/KPNN, pnn.py	Y Qu, et al. Product-based Neural Networks for User Response Prediction, 2016.
Neural Factorization Machine	NFM, nfm.py	X He and TS Chua, Neural Factorization Machines for Sparse Predictive Analytics, 2017.
DeepFM	DeepFM, dfm.py	H Guo, et al. DeepFM: A Factorization-Machine based Neural Network for CTR Prediction, 2017.
Deep & Cross Network	DCN/DCN+, dcn.py	R Wang, et al. Deep & Cross Network for Ad Click Predictions, 2017.
Gated Linear Unit	SA_GLU, sa_glu.py	Y N. Dauphin, et al. Language Modeling with Gated Convolutional Networks, 2017
xDeepFM	CIN/xDeepFM, xdfm.py	J Lian, et al. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, 2018.
Context-Aware Self-Attention Network	GC_ARM, gc_arm.py	B Yang, et al. Context-Aware Self-Attention Networks, 2019
AFN	AFN/AFN+, afn.py	W Cheng, et al. Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions, 2020.
ARM-Net	ARM-Net/ARM-Net+, armnet.py	S Cai, et al. ARM-Net: Adaptive Relation Modeling Network for Structured Data, 2021.

Citation

If you use our code in your research, please kindly cite:

@inproceedings{DBLP:conf/sigmod/CaiZ0JOZ21,
  author    = {Shaofeng Cai and
               Kaiping Zheng and
               Gang Chen and
               H. V. Jagadish and
               Beng Chin Ooi and
               Meihui Zhang},
  title     = {ARM-Net: Adaptive Relation Modeling Network for Structured Data},
  booktitle = {{SIGMOD} '21: International Conference on Management of Data, Virtual
               Event, China, June 20-25, 2021},
  pages     = {207--220},
  publisher = {{ACM}},
  year      = {2021},
}

Contact

To ask questions or report issues, you can directly drop us an email.

PyTorch implementation of ARM-Net: Adaptive Relation Modeling Network for Structured Data.

Related tags

Overview

ARM-Net: Adaptive Relation Modeling Network for Structured Data

Benchmark Dataset

Baseline Model

Citation

Contact

Owner

MoveNetを用いたPythonでの姿勢推定のデモ

ReAct: Out-of-distribution Detection With Rectified Activations

Reproduce partial features of DeePMD-kit using PyTorch.

This is the official source code for SLATE. We provide the code for the model, the training code, and a dataset loader for the 3D Shapes dataset. This code is implemented in Pytorch.

Investigating Attention Mechanism in 3D Point Cloud Object Detection (arXiv 2021)

BaseCls BaseCls 是一个基于 MegEngine 的预训练模型库，帮助大家挑选或训练出更适合自己科研或者业务的模型结构

An open-source outlier detection package by Getcontact Data Team

PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

This repo provides function call to track multi-objects in videos

Supervised domain-agnostic prediction framework for probabilistic modelling

Tutorial repo for an end-to-end Data Science project

BESS: Balanced Evolutionary Semi-Stacking for Disease Detection via Partially Labeled Imbalanced Tongue Data

《LXMERT: Learning Cross-Modality Encoder Representations from Transformers》(EMNLP 2020)

MEDS: Enhancing Memory Error Detection for Large-Scale Applications

On Effective Scheduling of Model-based Reinforcement Learning

Code for unmixing audio signals in four different stems "drums, bass, vocals, others". The code is adapted from "Jukebox: A Generative Model for Music"

Melanoma Skin Cancer Detection using Convolutional Neural Networks and Transfer Learning🕵🏻‍♂️

Rule Based Classification Project For Python

Implementation of momentum^2 teacher

A repository built on the Flow software package to explore cyber-security attacks on intelligent transportation systems.