Cooperative multi-robot reinforcement learning: A framework in hybrid state space

Xueqing Sun, Tao Mao, Jerald D. Kralik, Laura E. Ray
2009 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems  
In the area of autonomous multi-robot cooperation, much emphasis has been placed on how to coordinate individual robot behaviors in order to achieve an optimal solution to task completion as a team. This paper presents an approach to cooperative multi-robot reinforcement learning based on a hybrid state space representation of the environment to achieve both task learning and heterogeneous role emergence in a unified framework. The methodology also involves learning space reduction through a
more » ... ral perception module and a progressive rescheduling algorithm that interleaves online execution and relearning to adapt to environmental uncertainties and enhance performance. The approach aims to reduce combinatorial complexity inherent in role-task optimization, and achieves a satisficing solution to complex team-based tasks, rather than a globally optimal solution. Empirical evaluation of the proposed framework is conducted through simulation of a foraging task.
doi:10.1109/iros.2009.5354406 dblp:conf/iros/SunMKR09 fatcat:f6oi3ltwqvf3rimebrdn4nuv2u