A unified evaluation framework for head motion prediction methods in 360° videos

Miguel Fabián Romero Rondón, Lucile Sassatelli, Ramón Aparicio-Pardo, Frédéric Precioso
2020 Proceedings of the 11th ACM Multimedia Systems Conference  
The streaming transmissions of 360°videos is a major challenge for the development of Virtual Reality, and require a reliable head motion predictor to identify which region of the sphere to send in high quality and save data rate. Different head motion predictors have been proposed recently. Some of these works have similar evaluation metrics or even share the same dataset, however, none of them compare with each other. In this article we introduce an open software that enables to evaluate
more » ... ogeneous head motion prediction methods on various common grounds. The goal is to ease the development of new head/eye motion prediction methods. We first propose an algorithm to create a uniform data structure from each of the datasets. We also provide the description of the algorithms used to compute the saliency maps either estimated from the raw video content or from the users' statistics. We exemplify how to run existing approaches on customizable settings, and finally present the targeted usage of our open framework: how to train and evaluate a new prediction method, and compare it with existing approaches and baselines in common settings. The entire material (code, datasets, neural network weights and documentation) is publicly available. CCS CONCEPTS • Computing methodologies → Model verification and validation; Virtual reality.
doi:10.1145/3339825.3394934 dblp:conf/mmsys/Romero-RondonSA20 fatcat:wkqpzje3mvd55h2ixz4rsbh3mi