A proto-object based saliency model in three-dimensional space

Brian Hu, Ralinkae Kane-Jackson, Ernst Niebur
2016 Vision Research  
Most models of visual saliency operate on two-dimensional images, using elementary image features such as intensity, color, or orientation. The human visual system, however, needs to function in complex three-dimensional environments, where depth information is often available and may be used to guide the bottom-up attentional selection process. In this report we extend a model of proto-object based saliency to include depth information and evaluate its performance on three separate
more » ... ional eye tracking datasets. Our results show that the additional depth information provides a small, but statistically significant, improvement in the model's ability to predict perceptual saliency (eye fixations) in natural scenes. The computational mechanisms of our model have direct neural correlates, and our results provide further evidence that proto-objects help to establish perceptual organization of the scene. Graphical Abstract 1
doi:10.1016/j.visres.2015.12.004 pmid:26739278 pmcid:PMC4749459 fatcat:edangjzxbja5vn53nx4kzt6fqy