Consistent interactive augmentation of live camera images with correct near-field illumination

Thorsten Grosch, Tobias Eble, Stefan Mueller
2007 Proceedings of the 2007 ACM symposium on Virtual reality software and technology - VRST '07  
Inserting virtual objects in real camera images with correct lighting is an active area of research. Current methods use a high dynamic range camera with a fish-eye lens to capture the incoming illumination. The main problem with this approach is the limitation to distant illumination. Therefore, the focus of our work is a real-time description of both near -and far-field illumination for interactive movement of virtual objects in the camera image of a real room. The daylight, which is coming
more » ... through the windows, produces a spatially varying distribution of indirect light in the room; therefore a near-field description of incoming light is necessary. Our approach is to measure the daylight from outside and to simulate the resulting indirect light in the room. To accomplish this, we develop a special dynamic form of the irradiance volume for real-time updates of indirect light in the room and combine this with importance sampling and shadow maps for light from outside. This separation allows object movements with interactive frame rates (10 -17 fps). To verify the correctness of our approach, we compare images of synthetic objects with real objects.
doi:10.1145/1315184.1315207 dblp:conf/vrst/GroschEM07 fatcat:hd4hyedknfaxvnhvqc3m4byzqu