Tour into the picture with water surface reflection and object movements

Jinho Park, Nambin Heo, Sunghee Choi, Sung Yong Shin
2006 Computer Animation and Virtual Worlds  
Given a still picture, tour into the picture (TIP) generates a walk-through animation of a 3D scene constructed from the picture. In this paper, we generalize TIP to deal with water surface reflection while allowing foreground objects to move. We formulate a non-linear optimization problem to find the 3D scene parameters with respect to the camera position, to automatically construct a reasonable 3D scene model, provided with a set of points and their corresponding points on the water surface.
more » ... o synthesize a stream of reflected images on the water surface in accordance with the camera movement, we propose a novel image-based approach, which makes the best of the limited information available in the input picture. Furthermore, we incorporate water surface movement data acquired from water simulation on top of stochastic motion textures for objects such as trees and plants, to create a dynamic scene. KEY WORDS: image-based rendering; tour into the picture; reflection map Motivation A picture, whether it is a painting or a photograph, is used as a medium to record an instance of an imaginary or real experience. This instance reminds us of lovely old memories or leads us to a world of imagination. Tour into the picture (TIP) by Horry et al. 1 facilitates a visual realization of such memories and imagination. The basic idea of TIP is to generate a walk-through(or fly-through) animation of a 3D scene constructed interactively from the input picture. TIP has dealt with mainly pictures consisting of mountains and hills, water with boats, skies with clouds, trees, and buildings and streets, which together exhibit beautiful scenes to remember. In the original TIP, all objects in the picture remain still unlike in the real world, in which objects respond to natural forces in an oscillatory fashion. Moreover, each object is modeled as a billboard with a portion of the input picture attached. However, a natural water surface shows a reflected image of the environment, which varies depending on the camera position.
doi:10.1002/cav.135 fatcat:ba6vunyodbcwfozanw5nnuku3y