User-perspective augmented reality magic lens from gradients

Domagoj Baričević, Tobias Höllerer, Pradeep Sen, Matthew Turk
2014 Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology - VRST '14  
a) (b) (c) Figure 1: An example Augmented Reality application showcasing the difference between user-perspective and device-perspective magic lens interfaces. (a) Real world environment only. (b) Augmented Reality scene with the conventional device-perspective magic lens. (c) AR scene rendered with our user-perspective magic lens prototype. Abstract In this paper we present a new approach to creating a geometricallycorrect user-perspective magic lens and a prototype device implementing the
more » ... ach. Our prototype uses just standard color cameras, with no active depth sensing. We achieve this by pairing a recent gradient domain image-based rendering method with a novel semi-dense stereo matching algorithm inspired by PatchMatch. Our stereo algorithm is simple but fast and accurate within its search area. The resulting system is a real-time magic lens that displays the correct user perspective with a high-quality rendering, despite the lack of a dense disparity map.
doi:10.1145/2671015.2671027 dblp:conf/vrst/BaricevicHST14 fatcat:wdmfbxuwyvfwhkfo7u5lh5jehe