Content Adaptive Representations of Omnidirectional Videos for Cinematic Virtual Reality

Matt Yu, Haricharan Lakshman, Bernd Girod
2015 Proceedings of the 3rd International Workshop on Immersive Media Experiences - ImmersiveME '15  
Cinematic virtual reality provides an immersive visual experience by presenting omnidirectional videos of real-world scenes. A key challenge is to develop efficient representations of omnidirectional videos in order to maximize coding efficiency under resource constraints, specifically, number of samples and bitrate. We formulate the choice of representation as a multi-dimensional, multiplechoice knapsack problem and show that the resulting representations adapt well to varying content. We also
more » ... ng content. We also show that separation of the sampling and bit allocation constraints leads to a computationally efficient solution using Lagrangian optimization with only minor performance loss. Results across images and videos show significant coding gains over standard representations.
doi:10.1145/2814347.2814348 dblp:conf/mm/YuLG15 fatcat:5zgkfwwkarcf7hq4lm3mdfsgui