Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

Official implementation of "MetaSDF: Meta-learning Signed Distance Functions"

This is the official pytorch implementation of Student Helping Teacher: Teacher Evolution via Self-Knowledge Distillation(TESKD)

Pytorch implementation for "Open Compound Domain Adaptation" (CVPR 2020 ORAL)

City Surfaces: City-scale Semantic Segmentation of Sidewalk Surfaces

Text Summarization - WCN — Weighted Contextual N-gram method for evaluation of Text Summarization

A Haskell kernel for IPython.

This project intends to use SVM supervised learning to determine whether or not an individual is diabetic given certain attributes.

Customer-Transaction-Analysis - This analysis is based on a synthesised transaction dataset containing 3 months worth of transactions for 100 hypothetical customers.

StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks

An Evaluation of Generative Adversarial Networks for Collaborative Filtering.

Semantic similarity computation with different state-of-the-art metrics

People movement type classifier with YOLOv4 detection and SORT tracking.

Traductor de lengua de señas al español basado en Python con Opencv y MedaiPipe

Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

BOVText: A Large-Scale, Multidimensional Multilingual Dataset for Video Text Spotting

Software for Multimodalty 2D+3D Facial Expression Recognition (FER) UI

U-Time: A Fully Convolutional Network for Time Series Segmentation

Official implementation of "StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation" (SIGGRAPH 2021)

The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color

Code implementing "Improving Deep Learning Interpretability by Saliency Guided Training"