An experimental multimedia system allowing 3-D visualization and eye-controlled interaction without user-worn devices

S. Pastoor, Jin Liu, S. Renault
1999 IEEE transactions on multimedia  
In this paper, a new kind of human-computer interface allowing three-dimensional (3-D) visualization of multimedia objects and eye-controlled interaction is proposed. In order to explore the advantages and limitations of the concept, a prototype system has been set up. The testbed includes a visual operating system for integrating novel forms of interaction with a 3-D graphic user interface, autostereoscopic (free-viewing) 3-D displays with close adaptation to the mechanisms of binocular
more » ... and solutions for nonintrusive eye-controlled interaction (videobased head and gaze tracking). The paper reviews the system's key components and outlines various applications implemented for user testing. Preliminary results show that most of the users are impressed by a 3-D graphic user interface and the possibility to communicate with a computer by simply looking at the object of interest. On the other hand, the results emphasize the need for a more intelligent interface agent to avoid misinterpretation of the user's eye-controlled input and to reset undesired activities. Index Terms-Eye-controlled interaction, gaze tracking, graphic user interface, head tracking, human-computer interaction, interface agent, 3-D display.
doi:10.1109/6046.748170 fatcat:etnqixph4fcmxbaefut7ke56ie