Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

"Projelerle Yapay Zeka Ve Bilgisayarlı Görü" Kitabımın projeleri

High level network definitions with pre-trained weights in TensorFlow

📚 A collection of Jupyter notebooks for learning and experimenting with OpenVINO 👓

FMA: A Dataset For Music Analysis

Computing Shapley values using VAEAC

Code repository for "Reducing Underflow in Mixed Precision Training by Gradient Scaling" presented at IJCAI '20

RLDS stands for Reinforcement Learning Datasets

Adversarial Framework for (non-) Parametric Image Stylisation Mosaics

Determined: Deep Learning Training Platform

FedCV: A Federated Learning Framework for Diverse Computer Vision Tasks

Official PyTorch implementation of "Evolving Search Space for Neural Architecture Search"

Learning with Noisy Labels via Sparse Regularization, ICCV2021

A decent AI that solves daily Wordle puzzles. Works with different websites with similar wordlists,.

Multimodal Temporal Context Network (MTCN)

Provided is code that demonstrates the training and evaluation of the work presented in the paper: "On the Detection of Digital Face Manipulation" published in CVPR 2020.

[NeurIPS 2021] Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

Implementation of Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning

novel deep learning research works with PaddlePaddle

More than a hundred strange attractors

Alpha-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression