Predator-Prey Q-Learning Based Collaborative Coverage Path Planning for Swarm Robotics

Watson, Michael; Ren, Hanchi; Arvin, Farshad; Hu, Junyan

Abstract

Coverage Path Planning (CPP) is an effective approach to let intelligent robots cover an area by finding feasible paths through the environment. In this paper, we focus on using reinforcement learning to learn about a given environment and find the most efficient path that explores all target points. To overcome the limitations caused by standard Q-learning based CPP that often fall into a local optimum and may be in-efficient in large-scale environments, two methods of improvement are considered, i.e., the use of a robot swarm working towards the same goal and the augmenting of the Q-learning algorithm to include a predator-prey based reward system. Existing predator-prey based reward systems provide rewards the further away an agent is from its predator, the paper adapts this concept to work within a robot swarm by simulating each agent of the swarm as both predator and prey. Simulation case studies and comparisons with the standard Q-learning show that the proposed method has a superior coverage performance in complicated environments.

Citation

Watson, M., Ren, H., Arvin, F., & Hu, J. (2024, August). Predator-Prey Q-Learning Based Collaborative Coverage Path Planning for Swarm Robotics. Presented at 2024 Annual Conference Towards Autonomous Robotic Systems (TAROS), London

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2024 Annual Conference Towards Autonomous Robotic Systems (TAROS)
• Start Date: Aug 21, 2024
• End Date: Aug 23, 2024
• Acceptance Date: Jun 28, 2024
• Online Publication Date: Dec 30, 2024
• Publication Date: Jan 1, 2025
• Deposit Date: Aug 9, 2024
• Publicly Available Date: Dec 30, 2024
• Journal: Lecture Notes in Computer Science
• Print ISSN: 0302-9743
• Peer Reviewed: Peer Reviewed
• Volume: 15052 LNAI
• Pages: 320-332
• Series Title: Lecture Notes in Computer Science
• Series ISSN: 0302-9743
• Book Title: 2024 Annual Conference Towards Autonomous Robotic Systems (TAROS)
• DOI: https://doi.org/10.1007/978-3-031-72062-8_28
• Public URL: https://durham-repository.worktribe.com/output/2745340
• Publisher URL: https://link.springer.com/conference/taros