Measuring Perceptual and Linguistic Complexity in Multilingual Grounded Language Data

Nisha Pillai, Cynthia Matuszek, Francis Ferraro
2021 Proceedings of the ... International Florida Artificial Intelligence Research Society Conference  
The success of grounded language acquisition using perceptual data (e.g., in robotics) is affected by the complexity of both the perceptual concepts being learned and the language describing those concepts. We present methods for analyzing this complexity, using both visual features and entropy-based evaluation of sentences. Our work illuminates core, quantifiable statistical differences in how language is used to describe different traits of objects, and the visual representation of those
more » ... ts. The methods we use provide an additional analytical tool for research in perceptual language learning.
doi:10.32473/flairs.v34i1.128450 fatcat:ep45qo7pwnfhjc7ppocklkqofm