ClonAR: Rapid redesign of real-world objects

Michael Csongei, Liem Hoang, Ulrich Eck, Christian Sandor
2012 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)  
Figure 1 : Users of our system can rapidly clone and edit real-world objects in our visuo-haptic Augmented Reality environment: (a) outside view. (b) view through the head-worn display; cloned flowers are being edited through a haptic device. (c) final model after deformation. (d) further example: a virtual hat was added to a cloned person. ABSTRACT ClonAR enables users to rapidly clone and edit real-world objects. First, real-world objects can be scanned using KinectFusion. Second, users can
more » ... it the scanned objects in our visuo-haptic Augmented Reality environment. Our whole pipeline does not use mesh representation of objects, but rather Signed Distance Fields, which are the output of KinectFusion. We directly render Signed Distance Fields haptically and visually. We do direct haptic rendering of Signed Distance Fields, which is faster and more flexible than rendering meshes. Visual rendering is performed by our custombuilt raymarcher, which facilitates realistic illumination effects like ambient occlusions and soft shadows. Our prototype demonstrates the whole pipeline. We further present several results of redesigned real-world objects.
doi:10.1109/ismar.2012.6402572 dblp:conf/ismar/CsongeiHES12 fatcat:4aa4pokwjrexte5dfv5645wmce