Towards new measures of information retrieval evaluation

William R. Hersh, Diane L. Elliot, David H. Hickam, Stephanie L. Wolf, Anna Molnar
<span title="">1995</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="" style="color: black;">Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR &#39;95</a> </i> &nbsp;
All of the methods cumently used to evaluate information retrieval (Ill) systems have limitations in their ability to measure how well users are able to acquire information. We utilized on approach to assessing information obtained based on the user's ability to answer qtrcstions from a shortanswer test. Senior medical students took the ten-question test and then searched one of (WO IR systems on the five questions for which they were least ccrtuin of their answer. Our results showed thtit
more &raquo; ... earching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="">doi:10.1145/215206.215355</a> <a target="_blank" rel="external noopener" href="">dblp:conf/sigir/HershEHWML95</a> <a target="_blank" rel="external noopener" href="">fatcat:4r5q4a5exfcifnnyapboxdu6i4</a> </span>
<a target="_blank" rel="noopener" href="" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href=""> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> </button> </a>