Position detection system of mobile robot in the warehouse enviroment

Last update: Nov 24, 2021

Overview

Autonomous-Forklift-System

🎯 About

An application that run the autonomous forklift paletization aglorithms. Projekt was created for Engineering Thesis. It was fully completed. The last release of this application is available in this repository. Alication uses image processing (OpenCV library) to detect the position of Acuco markers. Based on the calculated positions of the forklift, pallets and the storage place, the trajectories for the truck are generated (mainly using Voronoi graph and Dijsktra algorithm). Then the module responsible for communication with the robot controls it, so the robot collects choosed pallets and puts them one on top of the other in the designated warehouse.

🖥️ GUI

The interface was created using the PyQt5 and pyqtgraph libraries.The following elements are shown in the figure:

Menu bar - user can change the FPTV coefficient, communication port and baudrate.
Image transmission - user can choose between three views. The first view displays the real image from the camera. View 2 displays marked tags with their identifiers. The third view displays the trajectories for a robot and updates it with each move robot (fig. 3.22).
Entering identifiers - to start system, the user has to enter the robot ID and the pallet that the robot has deliver to the storage area.
Parameters - In the Module statuses table you can observe camera, communication and navigation module status. The Warehouse table shows the status graphically storage place. The Parameters table shows in sequence: camera number (by default 1), COM port (COM14 by default), baud rate (9600 by default), ratio FPTV (25 by default), fault information, phase one status, phase two status, and the number of steps remaining to complete the phase.
Start and progress button that starts the palletization process (Start). It is available only after the correct robot and pallette identifiers are entered

🔬 Tests

Correctness of generated paths - The correct route is considered to be a safe route to the destination. In the first phase the palette is the goal. The robot has to reach the pallet and then pick it up. In the second phase the goal is the storage area (warehouse). Result: Correct

Correctness of completing the route - A correctly covered route is characterized by a minimal error between generated route and the route taken by the robot. This is equivalent to maintenance safety assumptions for every traffic. Result: Correct

Correctness of multi-level storage - This test checks whether the palletiser is correctly stacking the pallets. It is necessary to consider the created system as a multi-level palletizing system. Result: Correct

🏁 Starting

# Clone this project
$ git clone https://github.com/KamilGos/Autonomous_Forklift_System

# Access
$ cd Autonomous_Forklift_System

# Run the project
$ sudo python3 main.py

📝 License

This project is under license from MIT. For more details, see the LICENSE file.

🧑‍💻 Author

Made with ❤️ by Kamil Goś

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Initial release for public github
Source code(tar.gz)
Source code(zip)

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

MOT-Tracking-by-Detection-Pipeline Tracking-by-Detection形式のMOT(Multi Object Trac

41 Nov 23, 2022

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Apache MXNet (incubating) for Deep Learning Apache MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to m

20.2k Jan 8, 2023

20.2k Jan 5, 2023

19.3k Feb 12, 2021

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

4.7k Dec 29, 2022

The UI as a mobile display for OP25

OP25 Mobile Control Head A 'remote' control head that interfaces with an OP25 instance. We take advantage of some data end-points left exposed for the

13 Dec 28, 2022

Apache MXNet (incubating) for Deep Learning Master Docs License Apache MXNet (incubating) is a deep learning framework designed for both efficiency an

29 Nov 16, 2022

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

spatial-intention-maps This code release accompanies the following paper: Spatial Intention Maps for Multi-Agent Mobile Manipulation Jimmy Wu, Xingyua

70 Jan 2, 2023

Spatial Action Maps for Mobile Manipulation (RSS 2020)

spatial-action-maps Update: Please see our new spatial-intention-maps repository, which extends this work to multi-agent settings. It contains many ne

27 Nov 30, 2022

Position detection system of mobile robot in the warehouse enviroment

Related tags

Overview

Autonomous-Forklift-System

🎯 About

🖥️ GUI

🔬 Tests

🏁 Starting

📝 License

🧑‍💻 Author

You might also like...

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

The UI as a mobile display for OP25

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

Spatial Action Maps for Mobile Manipulation (RSS 2020)

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Owner

Kamil Goś

This is the code for "HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields".

Continuum Learning with GEM: Gradient Episodic Memory

Session-based Recommendation, CoHHN, price preferences, interest preferences, Heterogeneous Hypergraph, Co-guided Learning, SIGIR2022

[NeurIPS 2021] "G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators"

Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Reproducing Results from A Hybrid Approach to Targeting Social Assistance

DGN pymarl - Implementation of DGN on Pymarl, which could be trained by VDN or QMIX

Official PyTorch code for "BAM: Bottleneck Attention Module (BMVC2018)" and "CBAM: Convolutional Block Attention Module (ECCV2018)"

Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

Megaverse is a new 3D simulation platform for reinforcement learning and embodied AI research

patchmatch和patchmatchstereo算法的python实现

Moer Grounded Image Captioning by Distilling Image-Text Matching Model

Narya API allows you track soccer player from camera inputs, and evaluate them with an Expected Discounted Goal (EDG) Agent

code and models for "Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation"

Source code of D-HAN: Dynamic News Recommendation with Hierarchical Attention Network

[ECCV2020] Content-Consistent Matching for Domain Adaptive Semantic Segmentation

World Models with TensorFlow 2

ESP32 python application to read data from a Tilt™ Hydrometer for homebrewing

FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control