Reinforcement learning-based aggregation for robot swarms

Date

2023-01-01

Author

Sadeghi Amjadi, Arash
Bilaloğlu, Cem
Turgut, Ali Emre
Na, Seongin
Şahin, Erol
Krajník, Tomáš
Arvin, Farshad

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

16
views

2
downloads

Cite This

Aggregation, the gathering of individuals into a single group as observed in animals such as birds, bees, and amoeba, is known to provide protection against predators or resistance to adverse environmental conditions for the whole. Cue-based aggregation, where environmental cues determine the location of aggregation, is known to be challenging when the swarm density is low. Here, we propose a novel aggregation method applicable to real robots in low-density swarms. Previously, Landmark-Based Aggregation (LBA) method had used odometric dead-reckoning coupled with visual landmarks and yielded better aggregation in low-density swarms. However, the method’s performance was affected adversely by odometry drift, jeopardizing its application in real-world scenarios. In this article, a novel Reinforcement Learning-based Aggregation method, RLA, is proposed to increase aggregation robustness, thus making aggregation possible for real robots in low-density swarm settings. Systematic experiments conducted in a kinematic-based simulator and on real robots have shown that the RLA method yielded larger aggregates, is more robust to odometry noise than the LBA method, and adapts better to environmental changes while not being sensitive to parameter tuning, making it better deployable under real-world conditions.

Subject Keywords

aggregation, bio-inspired, reinforcement learning, Swarm robotics

URI

https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85171266829&origin=inward
https://hdl.handle.net/11511/105750

Collections

Department of Mechanical Engineering, Article