This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

Vision Transformer and MLP-Mixer Architectures

PyTorch implementation for our AAAI 2022 Paper "Graph-wise Common Latent Factor Extraction for Unsupervised Graph Representation Learning"

Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

Modelisation on galaxy evolution using PEGASE-HR

ColBERT: Contextualized Late Interaction over BERT (SIGIR'20)

Machine-in-the-Loop Rewriting for Creative Image Captioning

My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot

Repo for EchoVPR: Echo State Networks for Visual Place Recognition

[ICCV21] Self-Calibrating Neural Radiance Fields

BBB streaming without Xorg and Pulseaudio and Chromium and other nonsense (heavily WIP)

Repositório para arquivos sobre o Módulo 1 do curso Top Coders da Let's Code + Safra

Internship Assessment Task for BaggageAI.

Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation (NeurIPS 2021)

Python script that analyses the given datasets and comes up with the best polynomial regression representation with the smallest polynomial degree possible

Irrigation controller for Home Assistant

Tweesent-back - Tweesent backend uses fastAPI as the web framework

A hifiasm fork for metagenome assembly using Hifi reads.

Ludwig is a toolbox that allows to train and evaluate deep learning models without the need to write code.

QueryFuzz implements a metamorphic testing approach to test Datalog engines.

This package contains deep learning models and related scripts for RoseTTAFold