Bringing adaptive & immersive interfaces to real-world multi-robot scenarios: application to surveillance and intervention in infrastructures

Juan jesus roldan, Elena pena-tapia, Pablo garcia-aunon, Jaime del cerr, Antonio barrientos
2019 IEEE Access  
This work was supported in part by the SAVIER (Situational Awareness VIrtual EnviRonment) project of Airbus Defence and Space; RoboCity2030-III-CM project (Robótica aplicada a la mejora de la calidad de vida de los ciudadanos. Fase III; S2013/MIT-2748), through the Programas de Actividades I+D en la Comunidad de Madrid and Structural Funds of the EU, and in part by the DPI2014-56985-R project (Protección robotizada de infraestructuras críticas) through the Ministerio de Economía y
more » ... of Gobierno de España. ABSTRACT Multiple robot missions imply a series of challenges for single human operators, such as managing high workloads or maintaining a correct level of situational awareness. Conventional interfaces are not prepared to face these challenges; however, new concepts have arisen to cover this need, such as adaptive and immersive interfaces. This paper reports the design and development of an adaptive and immersive interface, as well as a complete set of experiments carried out to establish comparisons with a conventional one. The interface object of study has been developed using virtual reality to bring operators into scenarios and allow an intuitive commanding of robots. Additionally, it is able to recognize the mission's state and show hints to the operators. The experiments were performed in both outdoor and indoor scenarios recreating an intervention after an accident in critical infrastructure. The results show the potential of adaptive and immersive interfaces in the improvement of workload, situational awareness and performance of operators in multi-robot missions.
doi:10.1109/access.2019.2924938 fatcat:teuk7oydxzfo3l6i7fa2et5d7m