DL & CV-based indicator toolset for the vehicle drivers via live dash-cam footage.

Overview

Vehicle Indicator Toolset

Deep Learning and Computer Vision based indicator toolset for vehicle drivers using live dash-cam footages.

Tracking of vehicles
The tracking of the vehicles with a track ID can be seen below.

|


Detection of the lanes.
Whenever the driver gets out of the lane, he will be displayed a warning to stay inside the lane.

|


Tail light detection
Detect all the tail lights of the vehicles applying brakes at night.

|


Traffic signal recognition
Warning is shown when to stop and resume again using traffic lights.

|



Vehicle collision estimation
Incase, a collision is estimated, driver is warned.

|



Pedestrian stepping
Whenever, pedestrian comes in our view, a warning is displayed.

|


Dependencies required:

  • Python 3.0
  • TensorFlow 2.0
  • openCV

Project Structure:

  • lanes:This folder contains files related to lane detection only.
  • tf-color: This folder contains files related to traffic light detection and detect the colour and accordingly give instructions to the driver.
  • tracked: This folder contains detection and tracking algorithm for the vehicles.
  • untracked: Detection and visualization only
  • utils: contains various functions that are used continuously again and again for different frames.
  • estimations: Detect pedestrians and vehicles too close to us that may cause collision.
  • cropping: Cropping frames using drag and drop or clicking points.
  • display: All the gifs shown above are stored here.

Requisities:

Download the tensorflow model from here.

  • Provide the path to the labels txt file using variable named PATH_TO_LABELS.
  • Provide the path to the tensorflow model using variable named model_name.
  • Make sure all the files are imported properly from the utils folder. If you get an error, add the location of the utils folder using sys module.
  • Tensorflow version 2.0 is must or else you may come across various error.

Working:

Run python integrate3.py or python intyolo.py after following the above mentioned requisities.
Now select the dash area for the car by clicking on multiple points as shown below. This is done to
remove detection of our own vehicle in some cases which may generate false results.

In the second step, select the area where searching of the lanes should be made. This may differ due to
the placement of dash-cams in the vehicle. The area above the horizon where road ends should not be selected.

Now, you can visualize the working and see the warnings/suggestions displayed to the driver.
All the works that are implemented individually are present in their respective folders, which are integrated together.
Old models may have some bugs now, as many files inside utils are changed.
Visit honors branch of models repository forked from tf/models to see more work on this project,
that I have done in google colab.

Drawbacks:

  • At night, searching for tail light should be made in the dark. If sufficient light is present, false cases can get introduced.
  • Tracking works good for bigger objects, while smaller may loose their track ID at places.
  • Threshold values used in lane detection needs to be altered depending on the roads and the quality of the videos.
  • Object detection needs to work properly for better results throughout. The model with higher accuracy should be downloaded from the link given above.
Owner
Alex Xu
Alex Xu
Edge Restoration Quality Assessment

ERQA - Edge Restoration Quality Assessment ERQA - a full-reference quality metric designed to analyze how good image and video restoration methods (SR

MSU Video Group 27 Dec 17, 2022
E-Ink Magic Calendar that automatically syncs to Google Calendar and runs off a battery powered Raspberry Pi Zero

MagInkCal This repo contains the code needed to drive an E-Ink Magic Calendar that uses a battery powered (PiSugar2) Raspberry Pi Zero WH to retrieve

2.8k Dec 28, 2022
Code for "Adversarial Attack Generation Empowered by Min-Max Optimization", NeurIPS 2021

Min-Max Adversarial Attacks [Paper] [arXiv] [Video] [Slide] Adversarial Attack Generation Empowered by Min-Max Optimization Jingkang Wang, Tianyun Zha

Jingkang Wang 12 Nov 23, 2022
Python implementation of O-OFDMNet, a deep learning-based optical OFDM system,

O-OFDMNet This includes Python implementation of O-OFDMNet, a deep learning-based optical OFDM system, which uses neural networks for signal processin

Thien Luong 4 Sep 09, 2022
Machine-in-the-Loop Rewriting for Creative Image Captioning

Machine-in-the-Loop Rewriting for Creative Image Captioning Data Annotated sources of data used in the paper: Data Source URL Mohammed et al. Link Gor

Vishakh P 6 Jul 24, 2022
Object Detection Projekt in GKI WS2021/22

tfObjectDetection Object Detection Projekt with tensorflow in GKI WS2021/22 Docker Container: docker run -it --name --gpus all -v path/to/project:p

Tim Eggers 1 Jul 18, 2022
A benchmark dataset for emulating atmospheric radiative transfer in weather and climate models with machine learning (NeurIPS 2021 Datasets and Benchmarks Track)

ClimART - A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Models Official PyTorch Implementation Using deep le

21 Dec 31, 2022
GE2340 project source code without credentials.

GE2340-Project-Public GE2340 project source code without credentials. Run the bot.py to start the bot Telegram: @jasperwong_ge2340_bot If the bot does

0 Feb 10, 2022
YKKDetector For Python

YKKDetector OpenCVを利用した機械学習データをもとに、VRChatのスクリーンショットなどからYKKさん(もとい「幽狐族のお姉様」)を検出できるソフトウェアです。 マニュアル こちらから実行環境のセットアップから解説する詳細なマニュアルをご覧いただけます。 ライセンス 本ソフトウェア

あんふぃとらいと 5 Dec 07, 2021
TransMorph: Transformer for Medical Image Registration

TransMorph: Transformer for Medical Image Registration keywords: Vision Transformer, Swin Transformer, convolutional neural networks, image registrati

Junyu Chen 180 Jan 07, 2023
The implementation of ICASSP 2020 paper "Pixel-level self-paced learning for super-resolution"

Pixel-level Self-Paced Learning for Super-Resolution This is an official implementaion of the paper Pixel-level Self-Paced Learning for Super-Resoluti

Elon Lin 41 Dec 15, 2022
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

What is xLearn? xLearn is a high performance, easy-to-use, and scalable machine learning package that contains linear model (LR), factorization machin

Chao Ma 3k Jan 03, 2023
ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

ManimML ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

259 Jan 04, 2023
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

Memory Efficient Attention Pytorch Implementation of a memory efficient multi-head attention as proposed in the paper, Self-attention Does Not Need O(

Phil Wang 180 Jan 05, 2023
Minimalistic PyTorch training loop

Backbone for PyTorch training loop Will try to keep it minimalistic. pip install back from back import Bone Features Progress bar Checkpoints saving/l

Kashin 4 Jan 16, 2020
Reaction SMILES-AA mapping via language modelling

rxn-aa-mapper Reactions SMILES-AA sequence mapping setup conda env create -f conda.yml conda activate rxn_aa_mapper In the following we consider on ex

16 Dec 13, 2022
Semantic Segmentation for Aerial Imagery using Convolutional Neural Network

This repo has been deprecated because whole things are re-implemented by using Chainer and I did refactoring for many codes. So please check this newe

Shunta Saito 27 Sep 23, 2022
CUda Matrix Multiply library.

cumm CUda Matrix Multiply library. cumm is developed during learning of CUTLASS, which use too much c++ template and make code unmaintainable. So I de

49 Dec 27, 2022
R interface to fast.ai

R interface to fastai The fastai package provides R wrappers to fastai. The fastai library simplifies training fast and accurate neural nets using mod

113 Dec 20, 2022
Face Mask Detection is a project to determine whether someone is wearing mask or not, using deep neural network.

face-mask-detection Face Mask Detection is a project to determine whether someone is wearing mask or not, using deep neural network. It contains 3 scr

amirsalar 13 Jan 18, 2022