Selection of Concept Detectors for Video Search by Ontology-Enriched Semantic Spaces

Xiao-Yong Wei, Chong-Wah Ngo, Yu-Gang Jiang
2008 IEEE transactions on multimedia  
This paper describes the construction and utilization of two novel semantic spaces, namely Ontology-enriched Semantic Space (OSS) and Ontology-enriched Orthogonal Semantic Space (OS 2 ), to facilitate the selection of concept detectors for video search. These two semantic spaces are enriched with ontology knowledge, while emphasizing consistent and uniform comparison of ontological relatedness among concepts for query-to-concept mapping. OS 2 , in addition to being a linear space like OSS, also
more » ... guarantees orthogonality of the semantic space. Compared with other ontology reasoning measures, both spaces are capable of providing platforms that offer a global view of concept inter-relatedness, by allowing evaluation of concept similarity in metric spaces. We simulate OSS and OS 2 by using LSCOM concepts and experiment search effectiveness with VIREO-374 concept detectors. Empirical observations indicate that the proposed semantic spaces enable more effective selection of concept detectors than eight other existing ontology measures. OS 2 , in particular, is better in providing a viable and reasonable solution for fusion of multiple concept detectors. Index Terms-Semantic space, ontology, concept-based video search, semantic detectors.
doi:10.1109/tmm.2008.2001382 fatcat:64zeljttpjeifobhzuswfxp6ue