DL & CV-based indicator toolset for the vehicle drivers via live dash-cam footage.

Overview

Vehicle Indicator Toolset

Deep Learning and Computer Vision based indicator toolset for vehicle drivers using live dash-cam footages.

Tracking of vehicles
The tracking of the vehicles with a track ID can be seen below.

|


Detection of the lanes.
Whenever the driver gets out of the lane, he will be displayed a warning to stay inside the lane.

|


Tail light detection
Detect all the tail lights of the vehicles applying brakes at night.

|


Traffic signal recognition
Warning is shown when to stop and resume again using traffic lights.

|



Vehicle collision estimation
Incase, a collision is estimated, driver is warned.

|



Pedestrian stepping
Whenever, pedestrian comes in our view, a warning is displayed.

|


Dependencies required:

  • Python 3.0
  • TensorFlow 2.0
  • openCV

Project Structure:

  • lanes:This folder contains files related to lane detection only.
  • tf-color: This folder contains files related to traffic light detection and detect the colour and accordingly give instructions to the driver.
  • tracked: This folder contains detection and tracking algorithm for the vehicles.
  • untracked: Detection and visualization only
  • utils: contains various functions that are used continuously again and again for different frames.
  • estimations: Detect pedestrians and vehicles too close to us that may cause collision.
  • cropping: Cropping frames using drag and drop or clicking points.
  • display: All the gifs shown above are stored here.

Requisities:

Download the tensorflow model from here.

  • Provide the path to the labels txt file using variable named PATH_TO_LABELS.
  • Provide the path to the tensorflow model using variable named model_name.
  • Make sure all the files are imported properly from the utils folder. If you get an error, add the location of the utils folder using sys module.
  • Tensorflow version 2.0 is must or else you may come across various error.

Working:

Run python integrate3.py or python intyolo.py after following the above mentioned requisities.
Now select the dash area for the car by clicking on multiple points as shown below. This is done to
remove detection of our own vehicle in some cases which may generate false results.

In the second step, select the area where searching of the lanes should be made. This may differ due to
the placement of dash-cams in the vehicle. The area above the horizon where road ends should not be selected.

Now, you can visualize the working and see the warnings/suggestions displayed to the driver.
All the works that are implemented individually are present in their respective folders, which are integrated together.
Old models may have some bugs now, as many files inside utils are changed.
Visit honors branch of models repository forked from tf/models to see more work on this project,
that I have done in google colab.

Drawbacks:

  • At night, searching for tail light should be made in the dark. If sufficient light is present, false cases can get introduced.
  • Tracking works good for bigger objects, while smaller may loose their track ID at places.
  • Threshold values used in lane detection needs to be altered depending on the roads and the quality of the videos.
  • Object detection needs to work properly for better results throughout. The model with higher accuracy should be downloaded from the link given above.
Owner
Alex Xu
Alex Xu
Pyramid Scene Parsing Network, CVPR2017.

Pyramid Scene Parsing Network by Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia, details are in project page. Introduction This

Hengshuang Zhao 1.5k Jan 05, 2023
Source code for "Understanding Knowledge Integration in Language Models with Graph Convolutions"

Graph Convolution Simulator (GCS) Source code for "Understanding Knowledge Integration in Language Models with Graph Convolutions" Requirements: PyTor

yifan 10 Oct 18, 2022
GoodNews Everyone! Context driven entity aware captioning for news images

This is the code for a CVPR 2019 paper, called GoodNews Everyone! Context driven entity aware captioning for news images. Enjoy! Model preview: Huge T

117 Dec 19, 2022
PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

PaddlePaddle Vision Transformers State-of-the-art Visual Transformer and MLP Models for PaddlePaddle šŸ¤– PaddlePaddle Visual Transformers (PaddleViT or

1k Dec 28, 2022
Ready-to-use code and tutorial notebooks to boost your way into few-shot image classification.

Easy Few-Shot Learning Ready-to-use code and tutorial notebooks to boost your way into few-shot image classification. This repository is made for you

Sicara 399 Jan 08, 2023
Additional functionality for use with fastai’s medical imaging module

fmi Adding additional functionality to fastai's medical imaging module To learn more about medical imaging using Fastai you can view my blog Install g

14 Oct 31, 2022
Easily benchmark PyTorch model FLOPs, latency, throughput, max allocated memory and energy consumption

ā± pytorch-benchmark Easily benchmark model inference FLOPs, latency, throughput, max allocated memory and energy consumption Install pip install pytor

Lukas Hedegaard 21 Dec 22, 2022
ICRA 2021 - Robust Place Recognition using an Imaging Lidar

Robust Place Recognition using an Imaging Lidar A place recognition package using high-resolution imaging lidar. For best performance, a lidar equippe

Tixiao Shan 293 Dec 27, 2022
Object tracking implemented with YOLOv4, DeepSort, and TensorFlow.

Object tracking implemented with YOLOv4, DeepSort, and TensorFlow. YOLOv4 is a state of the art algorithm that uses deep convolutional neural networks to perform object detections. We can take the ou

The AI Guy 1.1k Dec 29, 2022
Simple SN-GAN to generate CryptoPunks

CryptoPunks GAN Simple SN-GAN to generate CryptoPunks. Neural network architecture and training code has been modified from the PyTorch DCGAN example.

Teddy Koker 66 Dec 15, 2022
Implementation of popular bandit algorithms in batch environments.

batch-bandits Implementation of popular bandit algorithms in batch environments. Source code to our paper "The Impact of Batch Learning in Stochastic

Danil Provodin 2 Sep 11, 2022
Deep Convolutional Generative Adversarial Networks

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford, Luke Metz, Soumith Chintala All images in t

Alec Radford 3.4k Dec 29, 2022
[NeurIPS 2021] ā€œImproving Contrastive Learning on Imbalanced Data via Open-World Samplingā€,

Improving Contrastive Learning on Imbalanced Data via Open-World Sampling Introduction Contrastive learning approaches have achieved great success in

VITA 24 Dec 17, 2022
Tensorflow implementation of ID-Unet: Iterative Soft and Hard Deformation for View Synthesis.

ID-Unet: Iterative-view-synthesis(CVPR2021 Oral) Tensorflow implementation of ID-Unet: Iterative Soft and Hard Deformation for View Synthesis. Overvie

17 Aug 23, 2022
The official repo of the CVPR2021 oral paper: Representative Batch Normalization with Feature Calibration

Representative Batch Normalization (RBN) with Feature Calibration The official implementation of the CVPR2021 oral paper: Representative Batch Normali

Open source projects of ShangHua-Gao 76 Nov 09, 2022
The implementation for "Comprehensive Knowledge Distillation with Causal Intervention".

Comprehensive Knowledge Distillation with Causal Intervention This repository is a PyTorch implementation of "Comprehensive Knowledge Distillation wit

Xiang Deng 10 Nov 03, 2022
Selfplay In MultiPlayer Environments

This project allows you to train AI agents on custom-built multiplayer environments, through self-play reinforcement learning.

200 Jan 08, 2023
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond

GCNet for Object Detection By Yue Cao, Jiarui Xu, Stephen Lin, Fangyun Wei, Han Hu. This repo is a official implementation of "GCNet: Non-local Networ

Jerry Jiarui XU 1.1k Dec 29, 2022
Unofficial Alias-Free GAN implementation. Based on rosinality's version with expanded training and inference options.

Alias-Free GAN An unofficial version of Alias-Free Generative Adversarial Networks (https://arxiv.org/abs/2106.12423). This repository was heavily bas

dusk (they/them) 75 Dec 12, 2022
Code samples for my book "Neural Networks and Deep Learning"

Code samples for "Neural Networks and Deep Learning" This repository contains code samples for my book on "Neural Networks and Deep Learning". The cod

Michael Nielsen 13.9k Dec 26, 2022