Collaborating with a Mobile Robot: An Augmented Reality Multimodal Interface

Scott A. Green, Xioa Qi Chen, Mark Billinghurst, J. Geoffrey Chase
<span title="">2008</span> <i title="Elsevier BV"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/p3wtlm3j2fedxitkuu4bs3scau" style="color: black;">IFAC Proceedings Volumes</a> </i> &nbsp;
We have created an infrastructure that allows a human to collaborate in a natural manner with a robotic system. In this paper we describe our system and its implementation with a mobile robot. In our prototype the human communicates with the mobile robot using natural speech and gestures, for example, by selecting a point in 3D space and saying "go here" or "go behind that". The robot responds using speech so the human is able to understand its intentions and beliefs. Augmented Reality (AR)
more &raquo; ... nology is used to facilitate natural use of gestures and provide a common 3D spatial reference for both the robot and human, thus providing a means for grounding of communication and maintaining spatial awareness. This paper first discusses related work then gives a brief overview of AR and its capabilities. The architectural design we have developed is outlined and then a case study is discussed.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3182/20080706-5-kr-1001.02637">doi:10.3182/20080706-5-kr-1001.02637</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/anq3vd23wvgqzi7xmyu3dq2gza">fatcat:anq3vd23wvgqzi7xmyu3dq2gza</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170922041140/https://ir.canterbury.ac.nz/bitstream/handle/10092/2211/12612078_Green?sequence=1" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/ff/49/ff49f61e06571ebf4f02e9d3b517befb7a12123a.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3182/20080706-5-kr-1001.02637"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>