Collaborative and content-based image labeling

Ning Zhou, William K. Cheung, Xiangyang Xue, Guoping Qiu
2008 Pattern Recognition (ICPR), Proceedings of the International Conference on  
Many on-line photo sharing systems allow users to tag their images so as to support semantic image search. In this paper, we study how one can take advantages of the already-tagged images to (semi-)automate the labeling of newly uploaded ones. In particular, we propose a hybrid approach for the prediction where user-provided tags and image visual contents are fused under a unified probabilistic framework. Kernel smoothing and collaborative filtering techniques are explored for improving the
more » ... racy of the probabilistic models estimation. By comparing with some stateof-the-art content-based image labeling methods, we have empirically shown that 1) the proposed method can achieve comparable tag prediction accuracy when there is no user-provided tag, and that 2) it can significantly boost the prediction accuracy if the user can provide just a few tags.
doi:10.1109/icpr.2008.4761473 dblp:conf/icpr/ZhouCXQ08 fatcat:f4pmfmafaregxc3mve25i6shgu