Know2Look: Commonsense Knowledge for Visual Search

Sreyasi Nag Chowdhury, Niket Tandon, Gerhard Weikum
2016 Proceedings of the 5th Workshop on Automated Knowledge Base Construction  
With the rise in popularity of social media, images accompanied by contextual text form a huge section of the web. However, search and retrieval of documents are still largely dependent on solely textual cues. Although visual cues have started to gain focus, the imperfection in object/scene detection do not lead to significantly improved results. We hypothesize that the use of background commonsense knowledge on query terms can significantly aid in retrieval of documents with associated images.
more » ... To this end we deploy three different modalities -text, visual cues, and commonsense knowledge pertaining to the query -as a recipe for efficient search and retrieval.
doi:10.18653/v1/w16-1311 dblp:conf/akbc/ChowdhuryTW16 fatcat:ii6n6skhlfc5tg3lfksvgodj2m