This library provides an abstraction to perform Model Versioning using Weight & Biases.

Last update: Jan 28, 2022

Overview

Description

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Features

Version a new trained model
Promote a model to another stage (e.g production)

Example of usage

The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.

The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better

run = wandb.init(...)

# Create the desired artifact
artifact = versioner.create_artifact(
                            checkpoint='model.ckpt',
                            artifact_name='prueba',
                            artifact_type='model',
                            description='Prueba Wandb-MV',
                            metadata={
                                'val_metric': 78.0,
                                'test_metric': 0.0
                            })

# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='val_metric',
                        promotion_alias='best_model',
                        comparision_type='smaller'
                       )

This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.

versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
                        artifact_name='prueba',
                        artifact_type='model',
                        comparision_metric='test_metric',
                        promotion_alias='production',
                        comparision_type='smaller',
                        already_deployed=True
                        )

Next features

Allow providing a custom comparision function to promote a model
...

This library provides an abstraction to perform Model Versioning using Weight & Biases.

Related tags

Overview

Description

Features

Example of usage

Next features

Owner

Hector Lopez Almazan

RobustVideoMatting and background composing in one model by using onnxruntime.

Tiny Kinetics-400 for test

Using this you can control your PC/Laptop volume by Hand Gestures (pinch-in, pinch-out) created with Python.

InsTrim: Lightweight Instrumentation for Coverage-guided Fuzzing

Towards Debiasing NLU Models from Unknown Biases

Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch

Modular Gaussian Processes

Experimental solutions to selected exercises from the book [Advances in Financial Machine Learning by Marcos Lopez De Prado]

A PyTorch port of the Neural 3D Mesh Renderer

Python scripts form performing stereo depth estimation using the high res stereo model in PyTorch .

Wandb-predictions - WANDB Predictions With Python

A user-friendly research and development tool built to standardize RL competency assessment for custom agents and environments.

A repository for benchmarking neural vocoders by their quality and speed.

This is the official code for the paper "Ad2Attack: Adaptive Adversarial Attack for Real-Time UAV Tracking".

PyTorch implementation of 'Gen-LaneNet: a generalized and scalable approach for 3D lane detection'

A package for "Procedural Content Generation via Reinforcement Learning" OpenAI Gym interface.

📖 Deep Attentional Guided Image Filtering

WORD: Revisiting Organs Segmentation in the Whole Abdominal Region

AI Summer's complete catalog of articles

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning