Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

A simple, fully convolutional model for real-time instance segmentation.

A forwarding MPI implementation that can use any other MPI implementation via an MPI ABI

Scalable Optical Flow-based Image Montaging and Alignment

QueryFuzz implements a metamorphic testing approach to test Datalog engines.

Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296

This repo implements a 3D segmentation task for an airport baggage dataset.

Unofficial Implementation of MLP-Mixer, Image Classification Model

HAR-stacked-residual-bidir-LSTMs - Deep stacked residual bidirectional LSTMs for HAR

tsai is an open-source deep learning package built on top of Pytorch & fastai focused on state-of-the-art techniques for time series classification, regression and forecasting.

A PyTorch Implementation of "SINE: Scalable Incomplete Network Embedding" (ICDM 2018).

Real life contra a deep learning project built using mediapipe and openc

This repository contains code accompanying the paper "An End-to-End Chinese Text Normalization Model based on Rule-Guided Flat-Lattice Transformer"

CIFAR-10 Photo Classification

Implementation of the paper "Language-agnostic representation learning of source code from structure and context".

The implementation our EMNLP 2021 paper "Enhanced Language Representation with Label Knowledge for Span Extraction".

CSKG is a commonsense knowledge graph that combines seven popular sources into a consolidated representation

Pytorch reimplementation of the Mixer (MLP-Mixer: An all-MLP Architecture for Vision)

PlaidML is a framework for making deep learning work everywhere.

iNAS: Integral NAS for Device-Aware Salient Object Detection

Unofficial implementation of Pix2SEQ