2,348 Hits in 3.5 sec

Subtitle-based Viewport Prediction for 360-degree Virtual Tourism Video [article]

Chuanzhe Jing, Tho Nguyen Duc, Phan Xuan Tan, Eiji Kamioka
2022 arXiv   pre-print
Therefore, in this paper, a subtitle-based viewport prediction model for 360-degree virtual tourism videos is proposed.  ...  360-degree streaming videos can provide a rich immersive experiences to the users. However, it requires an extremely high bandwidth network.  ...  The obtained ground-truth saliency heat map are input to a CNN network to extract a saliency feature vector f (t) GT S which will be used for viewport prediction in the proposed model. B.  ... 
arXiv:2206.02367v1 fatcat:xfiy6kwvxrflbpbiq6sew2jwum

Gaze Prediction in Dynamic 360° Immersive Videos

Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, Shenghua Gao
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
Then we feed both the saliency maps and the corresponding images into a Convolutional Neural Network (CNN) for feature extraction.  ...  Extensive experiments validate the effectiveness of our method for gaze prediction in dynamic VR scenes. * Corresponding author ing problem in 360videos, from both the commercial and technology perspectives  ...  for better saliency prediction.  ... 
doi:10.1109/cvpr.2018.00559 dblp:conf/cvpr/XuDWSSYG18 fatcat:ix36vmyf3rbrne4d6iwp5wkcgy

Saliency Detection in 360$$^\circ $$∘ Videos [chapter]

Ziheng Zhang, Yanyu Xu, Jingyi Yu, Shenghua Gao
2018 Lecture Notes in Computer Science  
This paper presents a novel spherical convolutional neural network based scheme for saliency detection for 360videos.  ...  Comprehensive experiments validate the effectiveness of our spherical U-net for 360video saliency detection.  ...  There still exists some space to improve our method for video saliency prediction.  ... 
doi:10.1007/978-3-030-01234-2_30 fatcat:4q6kqlxqm5hy5mhjscwhr2yeu4

ATSal: An Attention Based Architecture for Saliency Prediction in 360 Videos [article]

Yasser Dahou, Marouane Tliba, Kevin McGuinness, Noel O'Connor
2020 arXiv   pre-print
Accordingly, researchers have proposed various saliency models for 360 video/images. This paper proposes ATSal, a novel attention based (head-eye) saliency model for 360\degree videos.  ...  The spherical domain representation of 360 video/image presents many challenges related to the storage, processing, transmission and rendering of omnidirectional videos (ODV).  ...  publication has emanated from research supported by Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289 P2, co-funded by the European Regional Development Fund, through the SFI Centre for  ... 
arXiv:2011.10600v1 fatcat:wes6y4glqrdcfdaos6nluhti5i

Cube Padding for Weakly-Supervised Saliency Prediction in 360 Videos [article]

Hsien-Tzu Cheng, Chun-Hung Chao, Jin-Dong Dong, Hao-Kai Wen, Tyng-Luh Liu, Min Sun
2018 arXiv   pre-print
Automatic saliency prediction in 360 videos is critical for viewpoint guidance applications (e.g., Facebook 360 Guide).  ...  To evaluate our method, we propose Wild-360, a new 360 video saliency dataset, containing challenging videos with saliency heatmap annotations.  ...  Acknowledgements We thank MOST-106-3114-E-007-008 and MediaTek for their support.  ... 
arXiv:1806.01320v1 fatcat:dbrcy25zzrft5efopsr3ua2ble

Cube Padding for Weakly-Supervised Saliency Prediction in 360° Videos

Hsien-Tzu Cheng, Chun-Hung Chao, Jin-Dong Dong, Hao-Kai Wen, Tyng-Luh Liu, Min Sun
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
Automatic saliency prediction in 360videos is critical for viewpoint guidance applications (e.g., Facebook 360 Guide).  ...  To evaluate our method, we propose Wild-360, a new 360video saliency dataset, containing challenging videos with saliency heatmap annotations.  ...  Acknowledgements We thank MOST-106-3114-E-007-008 and MediaTek for their support.  ... 
doi:10.1109/cvpr.2018.00154 dblp:conf/cvpr/ChengCDWLS18 fatcat:swpeogbh6nc43fi3ikeu4wpxp4

Deep reinforcement learning approach to predict head movement in 360° videos

Ambadkar Tanmay, Mazumdar Pramit
2022 IS&T International Symposium on Electronic Imaging Science and Technology  
Therefore, in this proposed network we utilise a saliency indicator for driving the reward function of the reinforcement learning framework.  ...  In addition to this, saliency estimation is proved to be a very powerful indicator for attention modelling.  ...  Acknowledgments We would like to thank IIIT Vadodara for providing access to the Param Shavak server, which is a facility provided by the Gujarat Council on Science and Technology, India. 367-4 IS&T  ... 
doi:10.2352/ei.2022.34.10.ipas-367 fatcat:4ikh5hrtufbdfktpl7tn54m7wu

QoE-Oriented Resource Allocation for 360-degree Video Transmission over Heterogeneous Networks [article]

Wei Huang, Lianghui Ding, Hung-Yu Wei, Jenq-Neng Hwang, Yiling Xu, Wenjun Zhang
2018 arXiv   pre-print
Besides, a novel buffer strategy is proposed to mitigate the influence of short-time prediction problem for transmitting 360-degree videos in time-varying networks.  ...  in 360-degree video streaming.  ...  However, as illustrated in Section I, buffer management schemes for traditional videos are not appropriate for 360-degree videos due to the short-time prediction nature of FoV.  ... 
arXiv:1803.07789v1 fatcat:tdgznm6m2ra2rjjt22hnehnp7a

Adaptive Panoramic Video Multicast Streaming with Limited FoV Feedback

Jie Li, Ling Han, Cong Zhang, Qiyue Li, Weitao Li, Zhile Yang
2020 Complexity  
Then, we design a QoE-driven panoramic video streaming system with a client/server (C/S) architecture, in which the server performs rate adaptation based on the bandwidth and the predicted FoV.  ...  Virtual reality (VR) provides an immersive 360-degree viewing experience and has been widely used in many areas.  ...  Acknowledgments is research was supported in part by the Fundamental Research Funds for the Central Universities, under Grant nos. JZ2019HGTB0089 and PA2020GDJQ0027.  ... 
doi:10.1155/2020/8832715 fatcat:hogx3l7h4rdmtka5eyqwp4gs4q

HSMF-Net: Semantic Viewport Prediction for Immersive Telepresence and On-Demand 360-degree Video [article]

Tamay Aykut, Basak Gülezyüz, Bernd Girod, Eckehard Steinbach
2020 arXiv   pre-print
An on-demand 360-degree video streaming framework is presented to prove its general validity.  ...  The proposed approach increases the perceived video quality while requiring a significantly lower transmission rate.  ...  Proper viewport (or HM) prediction is needed for immersive user experience both for live telepresence and on-demand 360video streaming.  ... 
arXiv:2009.04015v1 fatcat:exl7xwt2hzaaxjg6b3a34zoiw4

A unified evaluation framework for head motion prediction methods in 360° videos

Miguel Fabián Romero Rondón, Lucile Sassatelli, Ramón Aparicio-Pardo, Frédéric Precioso
2020 Proceedings of the 11th ACM Multimedia Systems Conference  
The streaming transmissions of 360°videos is a major challenge for the development of Virtual Reality, and require a reliable head motion predictor to identify which region of the sphere to send in high  ...  We also provide the description of the algorithms used to compute the saliency maps either estimated from the raw video content or from the users' statistics.  ...  Owing to this acute need for head motion prediction in 360°video streaming, a number of recent approaches have proposed deep neural networks meant to exploit the knowledge of the past positions and of  ... 
doi:10.1145/3339825.3394934 dblp:conf/mmsys/Romero-RondonSA20 fatcat:wkqpzje3mvd55h2ixz4rsbh3mi

Encoder-Decoder Based LSTM Model to Advance User QoE in 360-Degree Video

Muhammad Usman Younus, Rabia Shafi, Ammar Rafiq, Muhammad Rizwan Anjum, Sharjeel Afridi, Abdul Aleem Jamali, Zulfiqar Ali Arain
2022 Computers Materials & Continua  
Then, this prediction model is combined with a rate adaptation approach that assigns the bitrates to various tiles for 360-degree video frames under a given network capacity.  ...  The development of multimedia content has resulted in a massive increase in network traffic for video streaming.  ...  Acknowledgement: We would like to thank all reviewers for reviewing and giving valuable comments to improve the manuscript's quality.  ... 
doi:10.32604/cmc.2022.022236 fatcat:4vczirpgn5dl5dqwnwtcl736mi

State-of-the-art in 360 Video/Image Processing: Perception, Assessment and Compression [article]

Chen Li, Mai Xu, Shanyi Zhang, Patrick Le Callet
2019 arXiv   pre-print
First, this paper reviews both datasets and visual attention modelling approaches for 360 video/image.  ...  The spherical viewing range of 360 video/image accounts for huge data, which pose the challenges to 360 video/image processing in solving the bottleneck of storage, transmission, etc.  ...  [18] , such that the PanoSalNet approach can be used for 360°video saliency prediction.  ... 
arXiv:1905.00161v2 fatcat:uom7choft5h47gj6fdr66wlooa

Analysis of Object-Centric Visual Preference in 360-degree Videos

Min-Seok Lee, Seok Ho Baek, Yoo-Jeong Shim, Myeong-jin Leea
2021 IEEE Access  
After defining the static and dynamic properties of the objects of interest, we collect real-shot 360-degree videos and synthesize computer-generated 360-degree videos so that the objects have different  ...  by detecting and comparing static and dynamic properties of objects in a 360-degree video.  ...  VISUAL SALIENCY PREDICTION FOR 360-DEGREE IMAGES/VIDEOS Several studies have recently been performed to predict visual saliency maps for 360-degree images and videos [8] - [12] .  ... 
doi:10.1109/access.2021.3095284 fatcat:yh7n5ho5afekjfbkivn6tmfcfm

Functional gaze prediction in egocentric video

Si-Ahmed Naas, Xiaolan Jiang, Stephan Sigg, Yusheng Ji
2020 Proceedings of the 18th International Conference on Advances in Mobile Computing & Multimedia  
Streaming 360°videos to a head-mounted display (HMD) client is challenging due to their high network resource consumption and computational load.  ...  We propose a functional gaze prediction system that addresses these issues by relying on a tiling scheme for gaze prediction.  ...  ACKNOWLEDGMENTS The authors appreciate partial funding from Nokia Solutions and Networks.  ... 
doi:10.1145/3428690.3429174 fatcat:xvcrbjzcnffotjyb3ywztgvm6e
« Previous Showing results 1 — 15 out of 2,348 results