GROUNDING LANGUAGE IN PERCEPTION: A CONNECTIONIST MODEL OF SPATIAL TERMS AND VAGUE QUANTIFIERS

ANGELO CANGELOSI, KENNY R. COVENTRY, ROHANA RAJAPAKSE, DAN JOYCE, ALISON BACON, LYNN RICHARDS, STEVEN N. NEWSTEAD
2005 Modeling Language, Cognition and Action  
This paper presents a new connectionist model of spatial language based on real psycholinguistic data. It puts together various constraints on object knowledge ("what") and on object localisation ("where") in order to influence the comprehension of a range of linguistic terms, mirroring what participants do in experiments. The computational model consists of a vision processing module for input scenes, an Elman network module for the representation of object dynamics, and a dual-route network
more » ... r the production of object names and linguistic prepositions describing the scene. Preliminary simulations on the prediction of spatial term ratings are presented, and extensions of the model to vague quantifiers and other syntactic categories are considered.
doi:10.1142/9789812701886_0004 fatcat:jbxqlex4frhi5kvshl667tjade