Real-time high-resolution sparse voxelization with application to image-based modeling

Charles Loop, Cha Zhang, Zhengyou Zhang
2013 Proceedings of the 5th High-Performance Graphics Conference on - HPG '13  
Figure 1 : Several views of a model, with and without texture, reconstructed from eight cameras. This surface contains 2.5 million out of 1024 3 voxels. Computation plus rendering took 24 milliseconds. Abstract We present a system for real-time, high-resolution, sparse voxelization of an image-based surface model. Our approach consists of a coarse-to-fine voxel representation and a collection of parallel processing steps. Voxels are stored as a list of unsigned integer triples. An oracle kernel
more » ... decides, for each voxel in parallel, whether to keep or cull its voxel from the list based on an image consistency criterion of its projection across cameras. After a prefix sum scan, kept voxels are subdivided and the process repeats until projected voxels are pixel size. These voxels are drawn to a render target and shaded as a weighted combination of their projections into a set of calibrated RGB images. We apply this technique to the problem of smooth visual hull reconstruction of human subjects based on a set of live image streams. We demonstrate that human upper body shapes can be reconstructed to giga voxel resolution at greater than 30 fps on modern graphics hardware.
doi:10.1145/2492045.2492053 dblp:conf/egh/LoopZZ13 fatcat:rjqwjhuzcngepcitymfdldrnua