Voronoi-Based Multi-Robot Autonomous Exploration in Unknown Environments via Deep Reinforcement Learning

Hu, Junyan; Niu, Hanlin; Carrasco, Joaquin; Lennox, Barry; Arvin, Farshad

Abstract

Autonomous exploration is an important application of multi-vehicle systems, where a team of networked robots are coordinated to explore an unknown environment collaboratively. This technique has earned significant research interest due to its usefulness in search and rescue, fault detection and monitoring, localization and mapping, etc. In this paper, a novel cooperative exploration strategy is proposed for multiple mobile robots, which reduces the overall task completion time and energy costs compared to conventional methods. To efficiently navigate the networked robots during the collaborative tasks, a hierarchical control architecture is designed which contains a high-level decision making layer and a low-level target tracking layer. The proposed cooperative exploration approach is developed using dynamic Voronoi partitions, which minimizes duplicated exploration areas by assigning different target locations to individual robots. To deal with sudden obstacles in the unknown environment, an integrated deep reinforcement learning based collision avoidance algorithm is then proposed, which enables the control policy to learn from human demonstration data and thus improve the learning speed and performance. Finally, simulation and experimental results are provided to demonstrate the effectiveness of the proposed scheme.

Citation

Hu, J., Niu, H., Carrasco, J., Lennox, B., & Arvin, F. (2020). Voronoi-Based Multi-Robot Autonomous Exploration in Unknown Environments via Deep Reinforcement Learning. IEEE Transactions on Vehicular Technology, 69(12), https://doi.org/10.1109/tvt.2020.3034800

• Journal Article Type: Article
• Acceptance Date: Oct 19, 2020
• Online Publication Date: Oct 29, 2020
• Publication Date: 2020-12
• Deposit Date: May 27, 2022
• Journal: IEEE Transactions on Vehicular Technology
• Print ISSN: 0018-9545
• Electronic ISSN: 1939-9359
• Publisher: Institute of Electrical and Electronics Engineers
• Volume: 69
• Issue: 12
• DOI: https://doi.org/10.1109/tvt.2020.3034800
• Public URL: https://durham-repository.worktribe.com/output/1204132