UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society Title Incremental Effects of Mismatch during Picture-Sentence Integration: Evidence from Eye-Tracking Publication Date Incremental Effects of Mismatch during Picture-Sentence Integration: Evidence from Eye-tracking

Matthew Crocker, Pia Knoeferle, Pia Knoeferle, Matthew Crocker
2005 Proceedings of the Annual Meeting of the Cognitive Science Society   unpublished
A model of sentence-picture integration developed by Carpenter and Just (1975) predicts that picture-sentence integration ease/difficulty depends on picture-sentence match/mismatch respectively. Recent findings by Underwood, Jebbet, and Roberts (2004), however , fail to find a match/mismatch difference for serial picture-sentence presentation in a sentence verification study. In a sentence comprehension study with serial picture-sentence presentation we find no match/mismatch effect in total
more » ... effect in total sentence inspection times. However, inspection times for individual sentence regions reveal a mismatch effect at the very sentence constituent for which the corresponding picture constituent mismatches, and this in a study with a sentence comprehension rather than verification task. Drawing on insights about spoken sentence comprehension during the inspection of concurrent scenes, we suggest that the absence of a mismatch effect in the Underwood et al. studies might be due to grain size of gaze time analyses.
fatcat:n4wltdopabgarckqy6mdlebdya