Real-time pixel luminance optimization for dynamic multi-projection mapping

Christian Siegl, Matteo Colaianni, Lucas Thies, Justus Thies, Michael Zollhöfer, Shahram Izadi, Marc Stamminger, Frank Bauer
2015 ACM Transactions on Graphics  
Figure 1 : Photos of augmenting our Augustus statue (see Figure 2 ) with multiple projectors. First, an animated texture is projected onto the object. Second, the statue appears to be made of glass with a skull behind the surface and third, the object appears as a perfect mirror using an environment map. On the right, the contribution of the two projectors is visualized. Projector 1 is green, projector 2 is blue (see Figure 2 ). Abstract Using projection mapping enables us to bring virtual
more » ... bring virtual worlds into shared physical spaces. In this paper, we present a novel, adaptable and real-time projection mapping system, which supports multiple projectors and high quality rendering of dynamic content on surfaces of complex geometrical shape. Our system allows for smooth blending across multiple projectors using a new optimization framework that simulates the diffuse direct light transport of the physical world to continuously adapt the color output of each projector pixel. We present a real-time solution to this optimization problem using off-the-shelf graphics hardware, depth cameras and projectors. Our approach enables us to move projectors, depth camera or objects while maintaining the correct illumination, in realtime, without the need for markers on the object. It also allows for projectors to be removed or dynamically added, and provides compelling results with only commodity hardware.
doi:10.1145/2816795.2818111 fatcat:rhuxwel53jbs3bzusbfzqfwdsq