Filters








1,916 Hits in 5.3 sec

INST

Alistair Moffat, Peter Bailey, Falk Scholer, Paul Thomas
<span title="">2015</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ym4qbiso25flxacjl7t5dh6k3i" style="color: black;">Proceedings of the 20th Australasian Document Computing Symposium on ZZZ - ADCS &#39;15</a> </i> &nbsp;
A large number of metrics have been proposed to measure the effectiveness of information retrieval systems.  ...  writing an implementation.  ...  Handling Ties Ties in the ranking order also pose a challenge in INST, because of the adaptive nature of the metric.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2838931.2838938">doi:10.1145/2838931.2838938</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/adcs/MoffatBST15.html">dblp:conf/adcs/MoffatBST15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/tkxo36o6hzhr7jbwbr5t4b6gw4">fatcat:tkxo36o6hzhr7jbwbr5t4b6gw4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200509143550/https://minerva-access.unimelb.edu.au/bitstream/handle/11343/58264/adcs15-moffat.pdf;jsessionid=7186C3B23C2FC9909525D4F7FCE7E729?sequence=1" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/f7/ae/f7aed0e95ae4e885fdd1a757888a2b88fb55efb3.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2838931.2838938"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

User Models, Metrics and Measures of Search

Leif Azzopardi, Alistair Moffat, Paul Thomas, Guido Zuccon
<span title="2021-03-14">2021</span> <i title="ACM"> Proceedings of the 2021 Conference on Human Information Interaction and Retrieval </i> &nbsp;
Evaluation is central to Information Retrieval, and is how we compare the quality of systems.  ...  The tutorial is presented as a mix of on-line synchronous lecture, pre-recorded in-depth videos, and hands-on activities using the C/W/L toolkit for particpant's own evaluation tasks.  ...  MOTIVATION Effectiveness evaluation has played a central role in the development of information retrieval systems [10] .  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3406522.3446049">doi:10.1145/3406522.3446049</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/o63y4yvnsfbn5miuldj54nukyq">fatcat:o63y4yvnsfbn5miuldj54nukyq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210716162121/https://strathprints.strath.ac.uk/75110/1/Azzopardi_etal_CHIIR_2021_User_models_metrics_and_measures_of_search.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/54/1f/541fe82dbbc63d8e3a2c9c85b2ad7e7a3ea164f5.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3406522.3446049"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

UQV100

Peter Bailey, Alistair Moffat, Falk Scholer, Paul Thomas
<span title="">2016</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ibcfmixrofb3piydwg5wvir3t4" style="color: black;">Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval - SIGIR &#39;16</a> </i> &nbsp;
Information need "backstories" were written for 100 topics (or sub-topics) from the TREC 2013 and 2014 Web Tracks.  ...  We believe this test collection will unlock new opportunities for novel investigations and analysis, including for problems such as task-intent retrieval performance and consistency (independent of query  ...  Moreover, INST is an adaptive metric and becomes increasingly top-weighted as relevant documents are encountered.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2911451.2914671">doi:10.1145/2911451.2914671</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sigir/BaileyMST16.html">dblp:conf/sigir/BaileyMST16</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/badjuucmcrd6hbbb47xszn4rju">fatcat:badjuucmcrd6hbbb47xszn4rju</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20190218140338/https://static.aminer.org/pdf/20170130/pdfs/sigir/vmcnjydfiexh39qap6pl8drb0jryleo2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/cc/f7/ccf72f8c0262a9ccc981be62b126105786a391b0.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2911451.2914671"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

cwl_eval

Leif Azzopardi, Paul Thomas, Alistair Moffat
<span title="">2019</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ibcfmixrofb3piydwg5wvir3t4" style="color: black;">Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR&#39;19</a> </i> &nbsp;
We present a tool ("cwl_eval") which unifies many metrics typically used to evaluate information retrieval systems using test collections.  ...  We provide implementations of a number of recent metrics, including Time Biased Gain, U-Measure, Bejewelled Measure, and the Information Foraging Based Measure, as well as previous metrics such as Precision  ...  SUMMARY We have described the C/W/L evaluation framework, a toolkit and an application for evaluating information retrieval systems.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3331184.3331398">doi:10.1145/3331184.3331398</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sigir/AzzopardiTM19.html">dblp:conf/sigir/AzzopardiTM19</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/guwe6zevjrbchewxm2ta22dxmi">fatcat:guwe6zevjrbchewxm2ta22dxmi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200505085928/https://strathprints.strath.ac.uk/71233/1/Azzopardi_etal_SIGIR_2019_cwl_eval_an_evaluation_tool_for_information_retrieval.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/78/a4/78a44948f98a7148ae789cfdce40555735d9f06b.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3331184.3331398"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

User Variability and IR System Evaluation

Peter Bailey, Alistair Moffat, Falk Scholer, Paul Thomas
<span title="">2015</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ibcfmixrofb3piydwg5wvir3t4" style="color: black;">Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR &#39;15</a> </i> &nbsp;
Test collection design eliminates sources of user variability to make statistical comparisons among information retrieval (IR) systems more affordable.  ...  First, we explore the impact of widely differing queries that searchers construct for the same information need description.  ...  In addition, INSQ ′ is adaptive -as relevant documents are identified, the expected remaining search cost decreases. INST: An improved INSQ ′ In the formulation of Moffat et al.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2766462.2767728">doi:10.1145/2766462.2767728</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sigir/BaileyMST15.html">dblp:conf/sigir/BaileyMST15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ctaphtd565akbofhoxxkl36cwq">fatcat:ctaphtd565akbofhoxxkl36cwq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20150923183457/http://research.microsoft.com/pubs/246414/fp286-bailey.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/95/33/9533cce453af80638bb2914a929fc5c866b2d2b5.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2766462.2767728"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Hard Example Generation by Texture Synthesis for Cross-domain Shape Similarity Learning [article]

Huan Fu, Shunming Li, Rongfei Jia, Mingming Gong, Binqiang Zhao, Dacheng Tao
<span title="2020-10-27">2020</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
While metric learning with some adaptation techniques seems to be a natural solution to shape similarity learning, the performance is often unsatisfactory for fine-grained shape retrieval.  ...  The common routine is to map 2D images and 3D shapes into an embedding space and define (or learn) a shape similarity measure.  ...  Note that, in contrast to category-driven metric learning for image retrieval, each 3D shape is an individual instance (category).  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2010.12238v2">arXiv:2010.12238v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/rafxackjgjbprmfvc3zitlmwxe">fatcat:rafxackjgjbprmfvc3zitlmwxe</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201030002000/https://arxiv.org/pdf/2010.12238v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/0d/43/0d4388e6a89dd3c3e07c3e015991f95d06d08de6.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2010.12238v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>

Building Economic Models and Measures of Search

Leif Azzopardi, Alistair Moffat, Paul Thomas, Guido Zuccon
<span title="">2019</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ibcfmixrofb3piydwg5wvir3t4" style="color: black;">Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR&#39;19</a> </i> &nbsp;
We then show how information foraging theory can be used to measure the performance of an information retrieval system -connecting the theory of how people search with how we measure it.  ...  The third session focuses on how economics has been used to underpin the measurement of information retrieval systems and applications using the C/W/L framework (which reports the expected utility, expected  ...  Over the years, various economic concepts have been used with Information Retrieval (IR) Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3331184.3331379">doi:10.1145/3331184.3331379</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sigir/AzzopardiMTZ19.html">dblp:conf/sigir/AzzopardiMTZ19</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/x2yknzt44jckhjqml2fz2by5la">fatcat:x2yknzt44jckhjqml2fz2by5la</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200505131543/https://strathprints.strath.ac.uk/71232/1/Azzopardi_etal_SIGIR_2019_Building_economic_models_and_measures_of_search.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/cd/03/cd03db1bc3fb66fa22608085dbf1d8e6273d746e.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3331184.3331379"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

User behavior modeling for Web search evaluation

Fan Zhang, Yiqun Liu, Jiaxin Mao, Min Zhang, Shaoping Ma
<span title="">2020</span> <i title="Elsevier BV"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/bm3baoxewvempaqpsm7ytjgkci" style="color: black;">AI Open</a> </i> &nbsp;
Batch evaluation of the performance of search systems to their users has always been an essential issue in the field of information retrieval.  ...  In this survey, we comprehensively review the development of user behavior modeling for Web search evaluation and related works of different model-based evaluation metrics.  ...  The main focus of these works was the high value of the long-standing evaluation method, namely test collection based evaluation, for information retrieval research.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.aiopen.2021.02.003">doi:10.1016/j.aiopen.2021.02.003</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ir4hopyfy5asdoeddc3y64vk3a">fatcat:ir4hopyfy5asdoeddc3y64vk3a</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210527080345/https://pdf.sciencedirectassets.com/777606/1-s2.0-S2666651020X00027/1-s2.0-S2666651021000048/main.pdf?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEJf%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJHMEUCIQDG5CzmBYuiTp0XdLFzZM%2FBN3kvLa%2BXiIEVMBDgsZlZNgIgToYUSIzpYYmQFNZPCrfMRgH%2BYqUPGzjBWi9FVRrGd%2FMqtAMIQBADGgwwNTkwMDM1NDY4NjUiDFoMuMLEq1NKwhWRASqRA2FXTinCwHwocU4eyXsmBQw6KPT2SwWdxYbJCI%2BnMY5WFfATpqW0rEXpFfsfMFds5ndF0jHRNX3zsIYqktrlP3R6W%2B5xDjN%2FVrT82JoVLXnFmhhiD4A%2FrYXWfh%2FqioGkdcMUCqa9mzu%2F1nQEEQbu9mKiogHSAVd5F2PGYx%2BYUK0uc1BseBVQ6s%2F%2FMzSEg7eANlEBAqVhA8ln7tN4uBMOK29mpXSdSXROpkPcKXIMSay47AnU52iNlFRaP%2FdGtrswvDtxbMPbT2lFy%2Fw3nWnsJDSfrq8%2FgBCtL2n9cP%2Fq99CTkiQqFR7qox64uOXEvvhAGGH8hqT44cxdw2fRYIUz30fthropIoD0y8UZjCoNH0V%2FmeaMeDWBYU41l7L8C%2BQt8EK2cqFboM%2BWLIzxE%2B3W0GFyopVOPMEkx6jyIoIO1r%2BCiCMXJTUmqMsCWXpOpHUs2iiJ%2B2jaNatQyvW7g9dGng%2FiTONv4mOpQfPCW2RfXcRrS3ouje%2B4zMNg4eTotOxWt02wa0LCyipgznfFpmtbbqBTMPGAvYUGOusBSQIjm6a%2FTWu5Rc3%2FomGkmLN6TToa5R3Kq2ZCEQpIbnzEwN0KcWwn%2BmECVp4Ff7oAfqBf4SQ1NqDr%2B7FDqQASlUr3WSOsH9HmKKjitipPfomEBfzsOBw12hUUt3yvEW2YTScyMETjH10YtdbVsxgSq%2BWI6vM%2BafO2nPP2h7uwRN10psEbgZwgzLCkpGY6cAybWiFtPOod%2FGCgu1B3JBm22ZV5vR2ZYLa%2F5T45b%2FdtCxIYDVbHLYSzFSeIjOmpAI%2Frq%2BCRGUxJmhi9NMaM23TuoFKwrJLItIcctrk8mdbPqH93PWIK6tgNYd8zgQ%3D%3D&amp;X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Date=20210527T080340Z&amp;X-Amz-SignedHeaders=host&amp;X-Amz-Expires=300&amp;X-Amz-Credential=ASIAQ3PHCVTYUO4DJV5H%2F20210527%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Signature=2318b6fd4ffb1eea03518ade92c8f09bd9a1db4af64532b9a51e758c25d90597&amp;hash=b4fbf86da4efd63c88f737c346e4a465f0d74f642cc8a7d45de92e1e75710892&amp;host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&amp;pii=S2666651021000048&amp;tid=spdf-f01aea8e-29ec-4800-abc3-2169802736ef&amp;sid=76635998597f96450b3914c7da7a34cc71cdgxrqa&amp;type=client" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/cf/99/cf996ec2b63dd745b43ed2c5144d8c6fb22cead8.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.aiopen.2021.02.003"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> elsevier.com </button> </a>

Economic models of search

Leif Azzopardi
<span title="">2013</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ym4qbiso25flxacjl7t5dh6k3i" style="color: black;">Proceedings of the 18th Australasian Document Computing Symposium on - ADCS &#39;13</a> </i> &nbsp;
We then show how information foraging theory can be used to measure the performance of an information retrieval system -connecting the theory of how people search with how we measure it.  ...  The third session focuses on how economics has been used to underpin the measurement of information retrieval systems and applications using the C/W/L framework (which reports the expected utility, expected  ...  Over the years, various economic concepts have been used with Information Retrieval (IR) Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2537734.2537735">doi:10.1145/2537734.2537735</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/adcs/Azzopardi13.html">dblp:conf/adcs/Azzopardi13</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/czm52hk46jh45puoevfvlxe7ee">fatcat:czm52hk46jh45puoevfvlxe7ee</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200322105227/https://www.microsoft.com/en-us/research/uploads/prod/2019/06/SIGIR_2019_Evaluation_Tutorial.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/03/8c/038cf3f3c07af83f8c7f8ac8bbef73047e2fecdf.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2537734.2537735"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval [article]

Haoyu Lu and Nanyi Fei and Yuqi Huo and Yizhao Gao and Zhiwu Lu and Ji-Rong Wen
<span title="2022-05-20">2022</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
To overcome these limitations, we propose a novel COllaborative Two-Stream vision-language pretraining model termed COTS for image-text retrieval by enhancing cross-modal interaction.  ...  Importantly, our COTS is also applicable to text-to-video retrieval, yielding new state-ofthe-art on the widely-used MSR-VTT dataset.  ...  In real-world application scenarios, inference speed is an important evaluation metric for retrieval methods.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2204.07441v2">arXiv:2204.07441v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/txcudrqjdzep5gyt3z6bbesnoy">fatcat:txcudrqjdzep5gyt3z6bbesnoy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20220529200058/https://arxiv.org/pdf/2204.07441v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/95/c1/95c13fe68ff17548ed486d6068e8a6dd57788b48.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2204.07441v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>

Page 3273 of Psychological Abstracts Vol. 89, Issue 8 [page]

<span title="">2002</span> <i title="American Psychological Association"> <a target="_blank" rel="noopener" href="https://archive.org/details/pub_psychological-abstracts" style="color: black;">Psychological Abstracts </a> </i> &nbsp;
(Tokyo Inst of Technology, Graduate School of Information Science & Engineering, Dept of Computer Science, Tokyo, Japan) Theoretical and experimental evaluation of the subspace information criterion.  ...  (Austrian Research Inst for Artificial Intelligence (OFAI), Wien, Aus- tria) User profiling for the MELVIL knowledge retrieval system. Applied Artificial Intelligence, 2002(Apr), Vol 16(4), 243-281.  ... 
<span class="external-identifiers"> </span>
<a target="_blank" rel="noopener" href="https://archive.org/details/sim_psychological-abstracts_2002-08_89_8/page/3273" title="read fulltext microfilm" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Archive [Microfilm] <div class="menu fulltext-thumbnail"> <img src="https://archive.org/serve/sim_psychological-abstracts_2002-08_89_8/__ia_thumb.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a>

Towards Nuanced System Evaluation Based on Implicit User Expectations [chapter]

Paul Thomas, Peter Bailey, Alistair Moffat, Falk Scholer
<span title="">2015</span> <i title="Springer International Publishing"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/2w3awgokqne6te4nvlofavy5a4" style="color: black;">Lecture Notes in Computer Science</a> </i> &nbsp;
Information retrieval systems are often evaluated through the use of effectiveness metrics.  ...  That recent work has demonstrated that T , the user's a priori utility expectation, is correlated with the underlying nature of the information need; and hence that evaluation metrics should be sensitive  ...  We thank Xiaolu Lu for assistance with the data collection and Bodo von Billerbeck for assistance with query log mining.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-28940-3_26">doi:10.1007/978-3-319-28940-3_26</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/7qgypty2nne2lmtxihaaiq7jvm">fatcat:7qgypty2nne2lmtxihaaiq7jvm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200319032359/https://www.microsoft.com/en-us/research/wp-content/uploads/2016/04/airs84-cameraready.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/6c/f5/6cf55779541fb1276ac8f03a55a315c2cce56e59.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/978-3-319-28940-3_26"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> springer.com </button> </a>

Data-Driven Evaluation Metrics for Heterogeneous Search Engine Result Pages

Leif Azzopardi, Ryen W. White, Paul Thomas, Nick Craswell
<span title="2020-03-14">2020</span> <i title="ACM"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ogws5syk2zcefps6afdfc33say" style="color: black;">Proceedings of the 2020 Conference on Human Information Interaction and Retrieval</a> </i> &nbsp;
Evaluation metrics for search typically assume items are homogeneous. However, in the context of web search, this assumption does not hold.  ...  These results suggest that item heterogeneity should be accounted for when developing metrics for SERPs.  ...  We would also like to thank the anonymous reviewers for their insights, suggestions, and comments.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3343413.3377959">doi:10.1145/3343413.3377959</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/chiir/AzzopardiW0C20.html">dblp:conf/chiir/AzzopardiW0C20</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/tim67hg5hbgjlloozgpwtfkpdm">fatcat:tim67hg5hbgjlloozgpwtfkpdm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200505074216/https://strathprints.strath.ac.uk/71788/1/Azzopardi_etal_CHIIR_2020_Data_driven_evaluation_metrics_for_heterogeneous_search_engine_result_pages.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/18/84/1884f53a7c1ee20f0cbb2254599d3d7671c73720.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3343413.3377959"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Better Effectiveness Metrics for SERPs, Cards, and Rankings

Paul Thomas, Alistair Moffat, Peter Bailey, Falk Scholer, Nick Craswell
<span title="">2018</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ym4qbiso25flxacjl7t5dh6k3i" style="color: black;">Proceedings of the 23rd Australasian Document Computing Symposium on ZZZ - ADCS &#39;18</a> </i> &nbsp;
Offline metrics for IR evaluation are often derived from a user model that seeks to capture the interaction between the user and the ranking, conflating the interaction with a ranking of documents with  ...  In combination, these three mechanisms transform a wide range of common metrics into "card-aware" variants which allow for the gain from cards (or snippets), varying probabilities of clickthrough, and  ...  We thank Bodo von Billerbeck and Alex Moore for their help wrangling data. This work was partially supported by the Australian Research Council (Project DP180102687).  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3291992.3292002">doi:10.1145/3291992.3292002</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/adcs/ThomasMBSC18.html">dblp:conf/adcs/ThomasMBSC18</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/4tn2eu7qevdztdfhcxvcb3vdxa">fatcat:4tn2eu7qevdztdfhcxvcb3vdxa</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200322131018/https://www.microsoft.com/en-us/research/uploads/prod/2019/01/thomas-adcs-18.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/00/52/005201ce81f7a065cf2403614b20d60f9ef06467.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3291992.3292002"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Modeling the behavior of large scale reasoning systems using clustering and regression

Raluca Brehar, Ion Giosan, Andrei Vatavu, Mihai Negru, Sergiu Nedevschi
<span title="">2011</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/jvbp6ujxqzc5phcneqbu4e6izm" style="color: black;">2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing</a> </i> &nbsp;
We focus on modeling the performance specific behavior of LarKC 1 -The Large Knowledge Collider a platform for large scale integrated reasoning and Web-search.  ...  Our method performs machine learning on top of instrumented data and tries to find relations between input defined metrics and output metrics that describe the instrumentation observations of the LarKC  ...  They use information retrieval to transform free-text console logs into numerical features and based on these features identify the operational problems.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iccp.2011.6047863">doi:10.1109/iccp.2011.6047863</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/iccp2/BreharGVNN11.html">dblp:conf/iccp2/BreharGVNN11</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/muwrvrle5rf5tdrvvqralmb7fu">fatcat:muwrvrle5rf5tdrvvqralmb7fu</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180205182324/http://users.utcluj.ro:80/~igiosan/Resources/Papers/Modeling%20the%20Behavior%20of%20Large%20Scale%20Reasoning%20Systems%20Using%20Clustering%20and%20Regression.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/be/76/be76cfb0b2a933f5a4a741f597e862ba79562243.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/iccp.2011.6047863"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>
&laquo; Previous Showing results 1 &mdash; 15 out of 1,916 results