A camera-based interface for interaction with mobile handheld computers

Martin Hachet, Joachim Pouderoux, Pascal Guitton
2005 Proceedings of the 2005 symposium on Interactive 3D graphics and games - SI3D '05  
Figure 1 : The camera-based interface. Abstract Recent advances in mobile computing allow the users to deal with 3D interactive graphics on handheld computers. Although the computing resources and screen resolutions grow steadily, user interfaces for handheld computers do not change significantly. Consequently, we designed a new 3-DOF interface adapted to the characteristics of handheld computers. This interface tracks the movement of a target that the user holds behind the screen by analyzing
more » ... he video stream of the handheld computer camera. The position of the target is directly inferred from the color-codes that are printed on it using an efficient algorithm. The users can easily interact in realtime in a mobile setting. The visualization of the data is good as the target does not occlude the screen and the interaction techniques are not dependent on the orientation of the handheld computer. We used the interface in several test applications for the visualization of large images such as maps, the manipulation of 3D models, and the navigation in 3D scenes. This new interface favors the development of 2D and 3D interactive applications on handheld computers.
doi:10.1145/1053427.1053438 dblp:conf/si3d/HachetPG05 fatcat:q6t4umb6dnhkjkkubo5rqkv5xq