On the Interest of Spatial Relations and Fuzzy Representations for Ontology-Based Image Interpretation

Isabelle Bloch, Céline Hudelot, Jamal Atif
2006 Advances in Pattern Recognition  
In this paper we highlight a few features of the semantic gap problem in image interpretation. We show that semantic image interpretation can be seen as a symbol grounding problem. In this context, ontologies provide a powerful framework to represent domain knowledge, concepts and their relations, and to reason about them. They are likely to be more and more developed for image interpretation. A lot of image interpretation systems rely strongly on descriptions of objects through their
more » ... stics such as shape, location, image intensities. However, spatial relations are very important too and provide a structural description of the imaged phenomenon, which is often more stable and less prone to variability than pure object descriptions. We show that spatial relations can be integrated in domain ontologies. Because of the intrinsic vagueness we have to cope with, at different levels (image objects, spatial relations, variability, questions to be answered, etc.), fuzzy representations are well adapted and provide a consistent formal framework to address this key issue, as well as the associated reasoning and decision making aspects. Our view is that ontology-based methods can be very useful for image interpretation if they are associated to operational models relating the ontology concepts to image information. In particular, we propose operational models of spatial relations, based on fuzzy representations.
doi:10.1142/9789812772381_0002 fatcat:wrb4fehvhnf77o4mfx3ldm7zfe