DeepHawkeye is a library to detect unusual patterns in images using features from pretrained neural networks

Last update: Dec 13, 2022

Overview

English | 简体中文

Introduction

DeepHawkeye is a library to detect unusual patterns in images using features from pretrained neural networks

Reference PatchCore anomaly detection model

Major features

Using nominal (non-defective) example images only
Faiss(CPU/GPU)
TensorRT Deployment

Installation

$ git clone https://github.com/tbcvContributor/DeepHawkeye.git
$ pip install opencv-python
$ pip install scipy

# pytorch
$ pip install torch==1.8.0+cu111 torchvision==0.9.0+cu111 torchaudio==0.8.0 -f https://download.pytorch.org/whl/torch_stable.html


#install faiss
# CPU-only version（currently available on Linux, OSX, and Windows）
$ conda install -c pytorch faiss-cpu
# GPU(+CPU) version （containing both CPU and GPU indices, is available on Linux systems）
$ conda install -c pytorch faiss-gpu
# or for a specific CUDA version
$ conda install -c pytorch faiss-gpu cudatoolkit=10.2 # for CUDA 10.2

Checkpoints and Demo data

Wide ResNet-50-2 and demo data

[Google]

[Baidu],code:a14e

${ROOT}
   └——————weights
           └——————wide_r50_2.pth
   └——————demo_data
           └——————grid
                    └——————normal_data
                    └——————test_data
           └——————....

Demo

bulid normal lib
python demo_train.py -d ./demo_data/grid/normal_data -c grid
pytorch infer
python demo_test.py -d ./demo_data/grid/test_data -c grid
tensorrt infer
python demo_trt.py -d ./demo_data/grid/test_data -c grid -t ./weights/w_res_50.trt

Tutorials

Need normal example images to cover all scenarios as much as possible
Faiss Documentation Default IVFXX, PQ16

train args

def get_train_args():
    parser = argparse.ArgumentParser()
    parser.add_argument('-d','--total_img_paths',type=str, default=None)
    parser.add_argument('-c','--category',type=str, default=None)
    parser.add_argument('--batch_size', default=64)
    parser.add_argument('--embedding_layers',choices=['1_2', '2_3'], default='2_3')
    parser.add_argument('--input_size', default=(224, 224))
    parser.add_argument('--weight_path', default='./weights/wide_r50_2.pth')
    parser.add_argument('--normal_feature_save_path', default=f"./index_lib")
    parser.add_argument('--model_device', default="cuda:0")
    parser.add_argument('--max_cluster_image_num', default=1000,help='depend on CPU memory, more than total images number')
    parser.add_argument('--index_build_device', default=-1,help='CPU:-1 ,GPU number eg: 0, 1, 2 (only on Linux)')

tips：

--input_size: trade off between speed and accuracy of the result --max_cluster_image_num：If RAM allows, greater than or equal to the total number of samples

test args

def get_test_args():
    parser = argparse.ArgumentParser()
    parser.add_argument('-d', '--test_path', type=str, default=None)
    parser.add_argument('-c', '--category', type=str, default=None)
    parser.add_argument('--model_device', default="cuda:0")
    parser.add_argument('--test_batch_size', default=64)
    parser.add_argument('--embedding_layers', choices=['1_2', '2_3'], default='2_3')
    parser.add_argument('--input_size', default=(224, 224))
    parser.add_argument('--test_GPU', default=-1, help='CPU:-1,'
                                                       'GPU: num eg: 0, 1, 2'
                                                       'multi_GPUs:[0,1,...]')
    parser.add_argument('--save_heat_map_image', default=True)
    parser.add_argument('--heatmap_save_path',
                        default=fr'./results', help='heatmap save path')
    parser.add_argument('--threshold', default=2)
    parser.add_argument('--nprobe', default=10)
    parser.add_argument('--n_neighbors', type=int, default=5)
    parser.add_argument('--weight_path', default='./weights/wide_r50_2.pth')
    parser.add_argument('--normal_feature_save_path', default=f"./index_lib")

tips：

--threshold: depend on scores of anomaly data

result format：{filename}_{score}.jpg

TensorRT Deployment

License

This project is released under the Apache 2.0 license.

Code Reference

https://github.com/hcw-00/PatchCore_anomaly_detection embedding concat function : https://github.com/xiahaifeng1995/PaDiM-Anomaly-Detection-Localization-master

DeepHawkeye is a library to detect unusual patterns in images using features from pretrained neural networks

Related tags

Overview

Introduction

Installation

Checkpoints and Demo data

Demo

Tutorials

License

Code Reference

Owner

CV Newbie

DI-HPC is an acceleration operator component for general algorithm modules in reinforcement learning algorithms

Phy-Q: A Benchmark for Physical Reasoning

NAS-FCOS: Fast Neural Architecture Search for Object Detection (CVPR 2020)

Bridging Composite and Real: Towards End-to-end Deep Image Matting

Additional functionality for use with fastai’s medical imaging module

Domain Generalization with MixStyle, ICLR'21.

The Official PyTorch Implementation of DiscoBox.

An implementation for `Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction`

Mix3D: Out-of-Context Data Augmentation for 3D Scenes (3DV 2021)

Official repository for CVPR21 paper "Deep Stable Learning for Out-Of-Distribution Generalization".

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready inference.

Flow is a computational framework for deep RL and control experiments for traffic microsimulation.

nextPARS, a novel Illumina-based implementation of in-vitro parallel probing of RNA structures.

This is a deep learning-based method to segment deep brain structures and a brain mask from T1 weighted MRI.

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Implementation of Graph Transformer in Pytorch, for potential use in replicating Alphafold2

This project provides the proof of the uniqueness of the equilibrium and the global asymptotic stability.

Vertex AI: Serverless framework for MLOPs (ESP / ENG)

Second-order Attention Network for Single Image Super-resolution (CVPR-2019)

Artifacts for paper "MMO: Meta Multi-Objectivization for Software Configuration Tuning"