FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

Official Implementation of "Designing an Encoder for StyleGAN Image Manipulation"

[SIGIR22] Official PyTorch implementation for "CORE: Simple and Effective Session-based Recommendation within Consistent Representation Space".

A flexible submap-based framework towards spatio-temporally consistent volumetric mapping and scene understanding.

Code accompanying "Evolving spiking neuron cellular automata and networks to emulate in vitro neuronal activity," accepted to IEEE SSCI ICES 2021

Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes

Efficient Deep Learning Systems course

A bare-bones Python library for quality diversity optimization.

Meta graph convolutional neural network-assisted resilient swarm communications

Cossim - Sharpened Cosine Distance implementation in PyTorch

Additional environments compatible with OpenAI gym

NeROIC: Neural Object Capture and Rendering from Online Image Collections

A Python multilingual toolkit for Sentiment Analysis and Social NLP tasks

MAU: A Motion-Aware Unit for Video Prediction and Beyond, NeurIPS2021

Finite-temperature variational Monte Carlo calculation of uniform electron gas using neural canonical transformation.

This repository contains PyTorch code for Robust Vision Transformers.

This repository contains the reference implementation for our proposed Convolutional CRFs.

Bolt Online Learning Toolbox

Development kit for MIT Scene Parsing Benchmark

High frequency AI based algorithmic trading module.

FairMOT for Multi-Class MOT using YOLOX as Detector