Seongin Na
Federated Reinforcement Learning for Collective Navigation of Robotic Swarms
Na, Seongin; Roucek, Tomas; Ulrich, Jiri; Pikman, Jan; Krajnik, Tomas; Lennox, Barry; Arvin, Farshad
Authors
Tomas Roucek
Jiri Ulrich
Jan Pikman
Tomas Krajnik
Barry Lennox
Dr Farshad Arvin farshad.arvin@durham.ac.uk
Professor
Abstract
The recent advancement of Deep Reinforcement Learning (DRL) contributed to robotics by allowing automatic controller design. The automatic controller design is a crucial approach for designing swarm robotic systems, which require more complex controllers than a single robot system to lead a desired collective behaviour. Although the DRL-based controller design method showed its effectiveness for swarm robotic systems, the reliance on the central training server is a critical problem in real-world environments where robot-server communication is unstable or limited. We propose a novel Federated Learning (FL) based DRL training strategy (FLDDPG) for use in swarm robotic applications. Through the comparison with baseline strategies under a limited communication bandwidth scenario, it is shown that the FLDDPG method resulted in higher robustness and generalisation ability into a different environment and real robots, while the baseline strategies suffer from the limitation of communication bandwidth. This result suggests that the proposed method can benefit swarm robotic systems operating in environments with limited communication bandwidth, e.g., in high-radiation, underwater, or subterranean environments.
Journal Article Type | Article |
---|---|
Online Publication Date | Jan 25, 2023 |
Publication Date | Jan 25, 2023 |
Deposit Date | Feb 2, 2023 |
Journal | IEEE Transactions on Cognitive and Developmental Systems |
Print ISSN | 2379-8920 |
Electronic ISSN | 2379-8939 |
Publisher | Institute of Electrical and Electronics Engineers |
DOI | https://doi.org/10.1109/tcds.2023.3239815 |
Public URL | https://durham-repository.worktribe.com/output/1181454 |
You might also like
COSΦ: Artificial pheromone system for robotic swarms research
(2015)
Presentation / Conference Contribution
Omnipotent Virtual Giant for Remote Human–Swarm Interaction
(2021)
Presentation / Conference Contribution
Φ Clust: Pheromone-Based Aggregation for Robotic Swarms
(2018)
Presentation / Conference Contribution
Biohybrid Entities for Environmental Monitoring
(2021)
Presentation / Conference Contribution
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search