Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

Overview

AutoML in Healthcare Review

Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

Selected highlights from the 2020 AutoML Review [https://doi.org/10.1016/j.artmed.2020.101822] that reviewed over 2,160 works related to the field of automated machine learning.

The curated list of automated feature engineering tools for Automated Machine Learning

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0005

Method Work Feature Engineering Technique Used by how many works
Deep Feature Synthesis LINK Expand-Reduce 151
Explore Kit LINK Expand-Reduce 53
One Button Machine LINK Expand-Reduce 32
AutoLearn LINK Expand-Reduce 16
GP Feature Construction LINK Genetic Programming 68
Cognito LINK Hierarchical Greedy Search 38
RLFE LINK Reinforcement Learning 21
LFE LINK Meta-Learning 34

Automated machine learning pipeline optimizers

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0010

Method Work Optimization Algorithm Data Pre-Processing Feature Engineering Model Selection Hyperparameter Optimization Ensemble Learning Meta-Learning Used by how many works
Auto-Weka LINK Bayesian Optimization (SMAC) ✔️ ✔️ ✔️ 703
Auto-Sklearn LINK Joint Bayesian Optimization and Bandit Search (BOHB) ✔️ ✔️ ✔️ ✔️ ✔️ 542
TPOT LINK Evolutionary Algorithm ✔️ ✔️ ✔️ ✔️ 84
TuPAQ LINK Bandit Search ✔️ ✔️ 94
ATM LINK Joint Bayesian Optimization and Bandit Search ✔️ ✔️ ✔️ 29
Automatic Frankensteining LINK Bayesian Optimization ✔️ ✔️ ✔️ 12
ML-Plan LINK Hierarchical Task Networks (HTN) ✔️ ✔️ ✔️ 24
Autostacker LINK Evolutionary Algorithm ✔️ ✔️ ✔️ 18
AlphaD3M LINK Reinforcement Learning/Monte Carlo Tree Search ✔️ ✔️ ✔️ 8
Collaborative Filtering LINK Probabilistic Matrix Factorization ✔️ ✔️ ✔️ ✔️ 29

Neural Architecture Search algorithms, based on performance on the CIFAR-10 dataset

Full details in https://www.sciencedirect.com/science/article/pii/S0933365719310437?via%3Dihub#tbl0015

NAS Algorithm Work Search Space Search Strategy Performance Estimation Strategy Number of Parameters Search Time (GPU-days) Test Error (%)
Large-scale Evolution LINK Feed-Forward Networks Evolutionary Algorithm Naive Training and Validation 5.4M 2600 5.4
EAS LINK Feed-Forward Networks Reinforcement Learning and Network Morphism Short Training and Validation 23.4M 10 4.23
Hierarchical Evolution LINK Cell Motifs Evolutionary Algorithm Training and Validation on proposed CNN Cell 15.7M 300 3.75
NAS v3 LINK Multi-branched Networks Reinforcement Learning Naive Training and Validation 37.4M 22400 3.65
PNAS LINK Cell Motifs Sequential Model-Based Optimization (SMBO) Performance Prediction 3.2M 225 3.41
ENAS LINK Cell Motifs Reinforcement Learning One Shot 4.6M 0.45 2.89
ResNet + Regularization LINK HUMAN BASELINE HUMAN BASELINE HUMAN BASELINE 26.2M - 2.86
DARTS LINK Cell Motifs Gradient-Based Optimization Training and Validation on proposed CNN Cell 3.4M 4 2.83
NASNet-A LINK Cell Motifs Reinforcement Learning Naive Training and Validation 3.3M 2000 2.65
EENA LINK Cell Motifs Evolutionary Algorithm Performance Prediction 8.5M 0.65 2.56
Path-Level EAS LINK Cell Motifs Reinforcement Learning Short Training and Validation 14.3M 200 2.30
NAO LINK Cell Motifs Gradient-Based Optimization Performance Prediction 128M 200 2.11
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Horovod Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make dis

Horovod 12.9k Jan 07, 2023
Merlion: A Machine Learning Framework for Time Series Intelligence

Merlion is a Python library for time series intelligence. It provides an end-to-end machine learning framework that includes loading and transforming data, building and training models, post-processi

Salesforce 2.8k Jan 05, 2023
JMP is a Mixed Precision library for JAX.

Mixed precision training [0] is a technique that mixes the use of full and half precision floating point numbers during training to reduce the memory bandwidth requirements and improve the computatio

DeepMind 108 Dec 31, 2022
Machine-learning-dell - Repositório com as atividades desenvolvidas no curso de Machine Learning

📚 Descrição Neste curso da Dell aprofundamos nossos conhecimentos em Machine Learning. 🖥️ Aulas (Em curso) 1.1 - Python aplicado a Data Science 1.2

Claudia dos Anjos 1 Jan 05, 2022
Automatically create Faiss knn indices with the most optimal similarity search parameters.

It selects the best indexing parameters to achieve the highest recalls given memory and query speed constraints.

Criteo 419 Jan 01, 2023
Implementation of the Object Relation Transformer for Image Captioning

Object Relation Transformer This is a PyTorch implementation of the Object Relation Transformer published in NeurIPS 2019. You can find the paper here

Yahoo 158 Dec 24, 2022
Applied Machine Learning for Graduate Program in Computer Science (PPGCC)

Applied Machine Learning for Graduate Program in Computer Science (PPGCC) - Federal University of Santa Catarina

Jônatas Negri Grandini 1 Dec 22, 2021
LiuAlgoTrader is a scalable, multi-process ML-ready framework for effective algorithmic trading

LiuAlgoTrader is a scalable, multi-process ML-ready framework for effective algorithmic trading. The framework simplify development, testing, deployment, analysis and training algo trading strategies

Amichay Oren 458 Dec 24, 2022
ArviZ is a Python package for exploratory analysis of Bayesian models

ArviZ (pronounced "AR-vees") is a Python package for exploratory analysis of Bayesian models. Includes functions for posterior analysis, data storage, model checking, comparison and diagnostics

ArviZ 1.3k Jan 05, 2023
Simple, light-weight config handling through python data classes with to/from JSON serialization/deserialization.

Simple but maybe too simple config management through python data classes. We use it for machine learning.

Eren Gölge 67 Nov 29, 2022
Simulation of early COVID-19 using SIR model and variants (SEIR ...).

COVID-19-simulation Simulation of early COVID-19 using SIR model and variants (SEIR ...). Made by the Laboratory of Sustainable Life Assessment (GYRO)

José Paulo Pereira das Dores Savioli 1 Nov 17, 2021
This repo implements a Topological SLAM: Deep Visual Odometry with Long Term Place Recognition (Loop Closure Detection)

This repo implements a topological SLAM system. Deep Visual Odometry (DF-VO) and Visual Place Recognition are combined to form the topological SLAM system.

Best of Australian Centre for Robotic Vision (ACRV) 32 Jun 23, 2022
A Collection of Conference & School Notes in Machine Learning 🦄📝🎉

Machine Learning Conference & Summer School Notes. 🦄📝🎉

558 Dec 28, 2022
This repo includes some graph-based CTR prediction models and other representative baselines.

Graph-based CTR prediction This is a repository designed for graph-based CTR prediction methods, it includes our graph-based CTR prediction methods: F

Big Data and Multi-modal Computing Group, CRIPAC 47 Dec 30, 2022
Climin is a Python package for optimization, heavily biased to machine learning scenarios

climin climin is a Python package for optimization, heavily biased to machine learning scenarios distributed under the BSD 3-clause license. It works

Biomimetic Robotics and Machine Learning at Technische Universität München 177 Sep 02, 2022
Falken provides developers with a service that allows them to train AI that can play their games

Falken provides developers with a service that allows them to train AI that can play their games. Unlike traditional RL frameworks that learn through rewards or batches of offline training, Falken is

Google Research 223 Jan 03, 2023
Pandas-method-chaining is a plugin for flake8 that provides method chaining linting for pandas code

pandas-method-chaining pandas-method-chaining is a plugin for flake8 that provides method chaining linting for pandas code. It is a fork from pandas-v

Francis 5 May 14, 2022
Course files for "Ocean/Atmosphere Time Series Analysis"

time-series This package contains all necessary files for the course Ocean/Atmosphere Time Series Analysis, an introduction to data and time series an

Jonathan Lilly 107 Nov 29, 2022
Bayesian optimization based on Gaussian processes (BO-GP) for CFD simulations.

BO-GP Bayesian optimization based on Gaussian processes (BO-GP) for CFD simulations. The BO-GP codes are developed using GPy and GPyOpt. The optimizer

KTH Mechanics 8 Mar 31, 2022
Educational python for Neural Networks, written in pure Python/NumPy.

Educational python for Neural Networks, written in pure Python/NumPy.

127 Oct 27, 2022