On the Design and Exploitation of User's Personal and Public Information for Semantic Personal Digital Photograph Annotation

Supheakmungkol Sarin, Toshinori Nagahashi, Tadashi Miyosawa, Wataru Kameyama
2008 Advances in Multimedia  
Automating the process of semantic annotation of digital personal photographs is a crucial step towards efficient and effective management of this increasingly high volume of content. However, this is still a highly challenging task for the research community. This paper proposes a novel solution. Our solution integrates all contextual information availabletoandfromthe users, such as their daily emails, schedules, chat archives, web browsing histories, documents, online news, Wikipedia data,
more » ... so forth. We then analyze this information and extract important semantic terms, using them as semantic keyword suggestions for their photos. Those keywords are in the form of named entities, such as names of people, organizations, locations, and date/time as well as high frequency terms. Experiments conducted with 10 subjects and a total of 313 photos proved that our proposed approach can significantly help users with the annotation process. We achieved a 33% gain in annotation time as compared to manual annotation. We also obtained very positive results in the accuracy rate of our suggested keywords.
doi:10.1155/2008/592690 fatcat:34agu7oomjd3rl6ee4a4f7goa4