Position detection system of mobile robot in the warehouse enviroment

Last update: Nov 24, 2021

Overview

Autonomous-Forklift-System

🎯 About

An application that run the autonomous forklift paletization aglorithms. Projekt was created for Engineering Thesis. It was fully completed. The last release of this application is available in this repository. Alication uses image processing (OpenCV library) to detect the position of Acuco markers. Based on the calculated positions of the forklift, pallets and the storage place, the trajectories for the truck are generated (mainly using Voronoi graph and Dijsktra algorithm). Then the module responsible for communication with the robot controls it, so the robot collects choosed pallets and puts them one on top of the other in the designated warehouse.

🖥️ GUI

The interface was created using the PyQt5 and pyqtgraph libraries.The following elements are shown in the figure:

Menu bar - user can change the FPTV coefficient, communication port and baudrate.
Image transmission - user can choose between three views. The first view displays the real image from the camera. View 2 displays marked tags with their identifiers. The third view displays the trajectories for a robot and updates it with each move robot (fig. 3.22).
Entering identifiers - to start system, the user has to enter the robot ID and the pallet that the robot has deliver to the storage area.
Parameters - In the Module statuses table you can observe camera, communication and navigation module status. The Warehouse table shows the status graphically storage place. The Parameters table shows in sequence: camera number (by default 1), COM port (COM14 by default), baud rate (9600 by default), ratio FPTV (25 by default), fault information, phase one status, phase two status, and the number of steps remaining to complete the phase.
Start and progress button that starts the palletization process (Start). It is available only after the correct robot and pallette identifiers are entered

🔬 Tests

Correctness of generated paths - The correct route is considered to be a safe route to the destination. In the first phase the palette is the goal. The robot has to reach the pallet and then pick it up. In the second phase the goal is the storage area (warehouse). Result: Correct

Correctness of completing the route - A correctly covered route is characterized by a minimal error between generated route and the route taken by the robot. This is equivalent to maintenance safety assumptions for every traffic. Result: Correct

Correctness of multi-level storage - This test checks whether the palletiser is correctly stacking the pallets. It is necessary to consider the created system as a multi-level palletizing system. Result: Correct

🏁 Starting

# Clone this project
$ git clone https://github.com/KamilGos/Autonomous_Forklift_System

# Access
$ cd Autonomous_Forklift_System

# Run the project
$ sudo python3 main.py

📝 License

This project is under license from MIT. For more details, see the LICENSE file.

🧑‍💻 Author

Made with ❤️ by Kamil Goś

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Initial release for public github
Source code(tar.gz)
Source code(zip)

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

MOT-Tracking-by-Detection-Pipeline Tracking-by-Detection形式のMOT(Multi Object Trac

41 Nov 23, 2022

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Apache MXNet (incubating) for Deep Learning Apache MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to m

20.2k Jan 8, 2023

20.2k Jan 5, 2023

19.3k Feb 12, 2021

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

4.7k Dec 29, 2022

The UI as a mobile display for OP25

OP25 Mobile Control Head A 'remote' control head that interfaces with an OP25 instance. We take advantage of some data end-points left exposed for the

13 Dec 28, 2022

Apache MXNet (incubating) for Deep Learning Master Docs License Apache MXNet (incubating) is a deep learning framework designed for both efficiency an

29 Nov 16, 2022

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

spatial-intention-maps This code release accompanies the following paper: Spatial Intention Maps for Multi-Agent Mobile Manipulation Jimmy Wu, Xingyua

70 Jan 2, 2023

Spatial Action Maps for Mobile Manipulation (RSS 2020)

spatial-action-maps Update: Please see our new spatial-intention-maps repository, which extends this work to multi-agent settings. It contains many ne

27 Nov 30, 2022

Position detection system of mobile robot in the warehouse enviroment

Related tags

Overview

Autonomous-Forklift-System

🎯 About

🖥️ GUI

🔬 Tests

🏁 Starting

📝 License

🧑‍💻 Author

You might also like...

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

The UI as a mobile display for OP25

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

Spatial Action Maps for Mobile Manipulation (RSS 2020)

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Owner

Kamil Goś

AI Flow is an open source framework that bridges big data and artificial intelligence.

Synthetic Humans for Action Recognition, IJCV 2021

A general framework for inferring CNNs efficiently. Reduce the inference latency of MobileNet-V3 by 1.3x on an iPhone XS Max without sacrificing accuracy.

AISTATS 2019: Confidence-based Graph Convolutional Networks for Semi-Supervised Learning

LAVT: Language-Aware Vision Transformer for Referring Image Segmentation

MINERVA: An out-of-the-box GUI tool for offline deep reinforcement learning

Adversarial Framework for (non-) Parametric Image Stylisation Mosaics

Contains a bunch of different python programm tasks

Speed-Test - You can check your intenet speed using this tool

AutoML library for deep learning

Official source code of paper 'IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo'

VOS: Learning What You Don’t Know by Virtual Outlier Synthesis

code for paper"A High-precision Semantic Segmentation Method Combining Adversarial Learning and Attention Mechanism"

[ICML 2021] A fast algorithm for fitting robust decision trees.

[ICCV2021] 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds

Implementation of Fast Transformer in Pytorch

Turi Create simplifies the development of custom machine learning models.

Deep learning algorithms for muon momentum estimation in the CMS Trigger System

This repository contains the needed resources to build the HIRID-ICU-Benchmark dataset

Codes for Causal Semantic Generative model (CSG), the model proposed in "Learning Causal Semantic Representation for Out-of-Distribution Prediction" (NeurIPS-21)