724 Hits in 6.6 sec

Mental Focus Analysis Using the Spatio-temporal Correlation between Visual Saliency and Eye Movements

Ryo Yonetani, Hiroaki Kawashima, Takatsugu Hirayama, Takashi Matsuyama
2012 Journal of Information Processing  
The spatio-temporal correlation analysis between visual saliency and eye movements is presented for the estimation of the mental focus toward videos.  ...  We extract spatio-temporal dynamics patterns of saliency areas from the videos, which we refer to as saliency-dynamics patterns, and evaluate eye movements based on their correlation with the saliency-dynamics  ...  Conclusions We proposed to analyze the spatio-temporal correlation of dynamics between the visual saliency and eye movements for mental-focus estimation.  ... 
doi:10.2197/ipsjjip.20.267 fatcat:ay2ltyeqw5hzdpi2vlcrhclzqi

A Survey of Visual Attention Models

Seyyed Mohammad Reza Hashemi
2015 Ciência e Natura  
It categorizes some challenging model issues, including biological calculations, correlation with the set of eye-movement data, as well as bottom-up and top-to-down topics, explaining each in details.  ...  It also studies bottom-up models in comparison to top-to-down, spatial models compared to spatial-temporal ones, obvious attention against the hidden one, and space-based models against the object-based  ...  F3 indicates whether a model only uses spatial or spatio-temporal information to estimate the saliency.  ... 
doi:10.5902/2179460x20786 fatcat:yrn3zficbvfwfbdp5rckaxioj4

Modeling the influence of action on spatial attention in visual interactive environments

Ali Borji, Dicky N. Sihite, Laurent Itti
2012 2012 IEEE International Conference on Robotics and Automation  
Comparing with other top-down task-driven and bottom-up spatio-temporal models, our approach shows higher NSS scores in predicting eye positions.  ...  The basic idea is to learn a mapping from current mental state of the game player, represented by past actions and observations, to its gaze fixation.  ...  ; and 2) correlation among eye fixation and actions to be used for eye movement prediction later.  ... 
doi:10.1109/icra.2012.6224551 dblp:conf/icra/BorjiSI12 fatcat:co65ebf4obbc3dqn4pmqwki2dq

Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition [article]

Stefan Mathe, Cristian Sminchisescu
2013 arXiv   pre-print
Our studies not only shed light on the differences between computer vision spatio-temporal interest point image sampling strategies and the human fixations, as well as their impact for visual recognition  ...  First, we complement existing state-of-the art large scale dynamic computer vision annotated datasets like Hollywood-2 and UCF Sports with human eye movements collected under the ecological constraints  ...  will direct the observer to exhibit taskspecific eye movements or to focus such behavior early on during exposure.  ... 
arXiv:1312.7570v1 fatcat:rzrc4eidrzdg3aemj2pjgtxnou

State-of-the-Art in Visual Attention Modeling

Ali Borji, Laurent Itti
2013 IEEE Transactions on Pattern Analysis and Machine Intelligence  
Furthermore, we address several challenging issues with models, including biological plausibility of the computations, correlation with eye movement datasets, bottom-up and top-down dissociation, and constructing  ...  Modeling visual attention -particularly stimulus-driven, saliency-based attention -has been a very active research area over the past 25 years.  ...  HR0011-10-C-0034), the National Science Foundation (CRCNS grant number BCS-0827764), the General Motors Corporation, and the Army Research Office (grant number W911NF-08-1-0360).  ... 
doi:10.1109/tpami.2012.89 pmid:22487985 fatcat:unx6oe5wfracdcxhcrocwgfspm

Multi-mode saliency dynamics model for analyzing gaze and attention

Ryo Yonetani, Hiroaki Kawashima, Takashi Matsuyama
2012 Proceedings of the Symposium on Eye Tracking Research and Applications - ETRA '12  
We present a method to analyze a relationship between eye movements and saliency dynamics in videos for estimating attentive states of users while they watch the videos.  ...  The multi-mode saliency-dynamics model (MMSDM) is introduced to segment spatio-temporal patterns of the saliency dynamics into multiple sequences of primitive modes underlying the saliency patterns.  ...  Acknowledgement This work is in part supported by MEXT Global COE program "Informatics Education and Research Center for a Knowledge-Circulating Society".  ... 
doi:10.1145/2168556.2168574 dblp:conf/etra/YonetaniKM12 fatcat:4i6dtkwm7vc7rpn7go4zn2a6ze

Scanpath modeling and classification with hidden Markov models

Antoine Coutrot, Janet H. Hsiao, Antoni B. Chan
2017 Behavior Research Methods  
., the sequence of eye movements made by an observer exploring a visual stimulus, can be used to infer observerrelated (e.g., task at hand) and stimuli-related (e.g., image semantic category) information  ...  Secondly, we use eye positions recorded while viewing 15 conversational videos, and infer a stimulus-related characteristic: the presence or absence of original soundtrack.  ...  (priors and transition matrix coefficients), and HMM spatio-temporal features (both).  ... 
doi:10.3758/s13428-017-0876-8 pmid:28409487 pmcid:PMC5809577 fatcat:quiexmw6rjbxpilppebb4eylm4

How Do People View Multi-Component Animated Maps?

Tomasz Opach, Izabela Gołębiowska, Sara Irina Fabrikant
2013 The Cartographic Journal  
Quite a few examples in the cartographic and information visualisation literature suggest that multi-component animated maps may be appropriate for examining complex spatio-temporal phenomena.  ...  We are also able to identify visual behaviour patterns that result in performance differences between participants, using multi-component animated map.  ...  We thankfully acknowledge colleagues from the Department of Geography of the University of Zürich for their help and constructive comments in this work.  ... 
doi:10.1179/1743277413y.0000000049 fatcat:xmv6uasucjeefpunjyo3jw2uzi

An inverse Yarbus process: Predicting observers' task from eye movement patterns

Amin Haji-Abolhassani, James J. Clark
2014 Vision Research  
In this paper we develop a probabilistic method to infer the visual-task of a viewer given measured eye movement trajectories.  ...  The results show that the HMM approach, combined with a clustering technique, can be a reliable way to infer visual-task from eye movements data.  ...  Acknowledgment The authors would like to thank Jeremy Wolfe and Ben Tatler, the reviewers of the manuscript, for their valuable comments, which helped us significantly improve the paper.  ... 
doi:10.1016/j.visres.2014.08.014 pmid:25175112 fatcat:7fzewtw6lfaktipyeikuu5udqm

Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study

Ali Borji, D. N. Sihite, L. Itti
2013 IEEE Transactions on Image Processing  
Furthermore, several concerns in visual saliency modeling, eye movement datasets, and evaluation scores are discussed and insights for future work are provided.  ...  The latter are often referred to as "visual saliency".  ...  The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressly or implied, of the Defense Advanced Research  ... 
doi:10.1109/tip.2012.2210727 pmid:22868572 fatcat:qgw3ua3gd5ekhnv6bdk34gub6a

Study of Saliency in Objective Video Quality Assessment

Wei Zhang, Hantao Liu
2017 IEEE Transactions on Image Processing  
With the assurance of the reliability of the saliency data, we thoroughly assessed the capabilities of saliency in improving the performance of VQMs, and devised a novel approach for optimal use of saliency  ...  A significant research trend is to investigate visual saliency and its implications for video quality assessment.  ...  It integrates both spatial and temporal (and spatio-temporal) aspects of distortion assessment, resulting in three different versions of the MOVIE index, namely the spatial MOVIE (SMOVIE), the temporal  ... 
doi:10.1109/tip.2017.2651410 pmid:28092556 fatcat:gcoonhzhovaxhiq5wsvefqpezm

Computational models: Bottom-up and top-down aspects [article]

Laurent Itti, Ali Borji
2015 arXiv   pre-print
We focus on computational models of attention as defined by Tsotsos & Rothenstein Tsotsos_Rothenstein11: Models which can process any visual stimulus (typically, an image or video clip), which can possibly  ...  as well as theoreticians, second, models have practical and technological applications of interest to the applied science and engineering communities.  ...  Acknowledgements Supported by the National Science Foundation (grant numbers BCS-0827764 and CMMI-1235539), the Army Research Office (W911NF-11-1-0046 and 62221-NS), the U.S.  ... 
arXiv:1510.07748v1 fatcat:3yikl7e6xfeyrbgrtfpx6ybo6y

Classification of Eye Fixation Related Potentials for Variable Stimulus Saliency

Markus A. Wenzel, Jan-Eike Golenia, Benjamin Blankertz
2016 Frontiers in Neuroscience  
Accordingly, the saliency of information, which allows to discriminate between relevant and irrelevant items, varies.  ...  Approach: Sixteen subjects performed a search task where the target saliency was varied while the EEG was recorded and the unrestrained eye movements were tracked.  ...  ACKNOWLEDGMENTS The authors would like to thank Marija Ušćumlić and the reviewers for very helpful comments on the manuscripts.  ... 
doi:10.3389/fnins.2016.00023 pmid:26912993 pmcid:PMC4753317 fatcat:yqg62v4tzrdsvgu6xlj3c6uche

Consciousness and the Binding Problem

2006 Annals of the New York Academy of Sciences  
dialogue between different brains and hence has the quality of a cultural construct.  ...  reapplying on themselves the very same cortical operations that they use for the interpretation of signals from the outer world.  ...  responsible for the execution of eye movements.  ... 
doi:10.1111/j.1749-6632.2001.tb05712.x fatcat:2cgaie57gvbx3kxqgjxgygwmsa

Cognitively Inspired and Perceptually Salient Graphic Displays for Efficient Spatial Inference Making

Sara Irina Fabrikant, Stacy Rebich Hespanha, Mary Hegarty
2010 Annals of the Association of American Geographers  
Analysis of the eye-movement patterns, however, suggests that display design does affect viewing behavior and response time.  ...  Key Words: empirical study, eye-movement analysis, geographic visualization, spatial inference, weather maps.  ...  Acknowledgments This material is based on work supported by the National Science Foundation under Grant No. 0350910, by the Swiss National Science Fund under Grant No. 200021-113745 (Sara Irina Fabrikant  ... 
doi:10.1080/00045600903362378 fatcat:6njrc5t5m5dzdoyxl6roxcp2zm
« Previous Showing results 1 — 15 out of 724 results