A perceptually based spatio-temporal computational framework for visual saliency estimation

Petros Koutras, Petros Maragos
2015 Signal processing. Image communication  
The purpose of this paper is to demonstrate a perceptually based spatio-temporal computational framework for visual saliency estimation. We have developed a new spatiotemporal visual frontend based on biologically inspired 3D Gabor filters, which is applied on both the luminance and the color streams and produces spatio-temporal energy maps. These volumes are fused for computing a single saliency map and can detect spatiotemporal phenomena that static saliency models cannot find. We also
more » ... a new movie database with eye-tracking annotation. We have evaluated our spatio-temporal saliency model on the widely used CRCNS-ORIG database as well as our new database using different fusion schemes and feature sets. The proposed spatio-temporal computational framework incorporates many ideas based on psychological evidences and yields significant improvements on spatio-temporal saliency estimation.
doi:10.1016/j.image.2015.08.004 fatcat:kha3povnbna5lbecznl2syefqm