Retargeting Technical Documentation to Augmented Reality

Peter Mohr, Bernhard Kerbl, Michael Donoser, Dieter Schmalstieg, Denis Kalkofen
2015 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15  
a) (c) (d) Figure 1. Retargeted 2D documentation. (a) The input documentation consists of an annotated explosion diagram and a sequence of images presenting disassembly instructions. (b) From analyzing the 2D explosion diagram, our system is able to generate a 3D explosion diagram presented in AR. Moreover, our system generates 3D annotations in AR based on the input 2D documentation. (c) In addition, our system is able to analyze image sequences in order to create 3D animations from it. This
more » ... ons from it. This allows to present animated 3D documentations in AR. Here we show six key-frames from the resulting AR animation. ABSTRACT We present a system which automatically transfers printed technical documentation, such as handbooks, to threedimensional Augmented Reality. Our system identifies the most frequent forms of instructions found in printed documentation, such as image sequences, explosion diagrams, textual annotations and arrows indicating motion. The analysis of the printed documentation works automatically, with minimal user input. The system only requires the documentation itself and a CAD model or 3D scan of the object described in the documentation. The output is a fully interactive Augmented Reality application, presenting the information from the printed documentation in 3D, registered to the real object.
doi:10.1145/2702123.2702490 dblp:conf/chi/MohrKDSK15 fatcat:rkzcbbt2ybeppmoy2x7vd6xr7a