Mining subtopics from different aspects for diversifying search results

Chieh-Jen Wang, Yung-Wei Lin, Ming-Feng Tsai, Hsin-Hsi Chen
<span title="2012-12-18">2012</span> <i title="Springer Nature"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/qkuxm4jkpnclphpwzqgsg7qnae" style="color: black;">Information retrieval (Boston)</a> </i> &nbsp;
User queries to the Web tend to have more than one interpretation due to their ambiguity and other characteristics. How to diversify the ranking results to meet users' various potential information needs has attracted considerable attention recently. This paper is aimed at mining the subtopics of a query either indirectly from the returned results of retrieval systems or directly from the query itself to diversify the search results. For the indirect subtopic mining approach, clustering the
more &raquo; ... ieval results and summarizing the content of clusters is investigated. In addition, labeling topic categories and concept tags on each returned document is explored. For the direct subtopic mining approach, several external resources, such as Wikipedia, Open Directory Project, search query logs, and the related search services of search engines, are consulted. Furthermore, we propose a diversified retrieval model to rank documents with respect to the mined subtopics for balancing relevance and diversity. Experiments are conducted on the ClueWeb09 dataset with the topics of the TREC09 and TREC10 Web Track diversity tasks. Experimental results show that the proposed subtopic-based diversification algorithm significantly outperforms the state-of-the-art models in the TREC09 and TREC10 Web Track diversity tasks. The best performance our proposed algorithm achieves is a-nDCG@5 0.307, IA-P@5 0.121, and a#-nDCG@5 0.214 on the TREC09, as well as a-nDCG@10 0.421, IA-P@10 0.201, and a#-nDCG@10 0.311 on the TREC10. The results conclude that the subtopic mining technique with the up-to-date users' search query logs is the most effective way to generate the subtopics of a query, and the proposed subtopic-based diversification algorithm can select the documents covering various subtopics.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s10791-012-9215-y">doi:10.1007/s10791-012-9215-y</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/l35ktd43zjdnffmy7enlmxrjse">fatcat:l35ktd43zjdnffmy7enlmxrjse</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170809124557/http://www.nlg.csie.ntu.edu.tw/~cjwang/paper/Mining%20Subtopics%20from%20Different%20Aspects%20for%20Diversifying%20Search%20Results.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/36/c6/36c68bc6c56349717a8f7ed7d7993fe961bf5b62.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s10791-012-9215-y"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> springer.com </button> </a>