Filters








684 Hits in 3.0 sec

TREC 2017 Tasks Track Overview

Evangelos Kanoulas, Emine Yilmaz, Rishabh Mehrotra, Ben Carterette, Nick Craswell, Peter Bailey
2017 Text Retrieval Conference  
We then give an overview of the runs submitted to the 2017 Tasks Track and present the evaluation results.  ...  Analysis on Task Understanding from 201to 2017 In this section we present a few results that span the three years of the TREC Tasks Track, and in particular the Task Understanding task.  ... 
dblp:conf/trec/KanoulasYMCCB17 fatcat:skpx7xka6ze55oklnjplgtwanu

CLEF 2017 Dynamic Search Evaluation Lab Overview [chapter]

Evangelos Kanoulas, Leif Azzopardi
2017 Lecture Notes in Computer Science  
Herein, we describe the overall objectives of the CLEF 2017 Dynamic Search Lab, the resources created for the pilot task, the evaluation methodology adopted, and some preliminary evaluation results of  ...  the Pilot task.  ...  Lab Overview The CLEF Dynamic Tasks Lab attempts to focus attention towards building a bridge between batch TREC-style evaluation methodology and the Interactive Information Retrieval evaluation methodology  ... 
doi:10.1007/978-3-319-65813-1_31 fatcat:bczfn7xtvbgivgyppwm7ka7xxy

Simple but Effective Knowledge-Based Query Reformulations for Precision Medicine Retrieval

Stefano Marchesin, Giorgio Maria Di Nunzio, Maristella Agosti
2021 Information  
We considered TREC PM 2017 (PM17) [20] , 2018 (PM18) [21] , and 2019 (PM19) [22] Tracks.  ...  " in Table 6 Clinical Trials of the TREC PM 2019 overview [22] ).  ... 
doi:10.3390/info12100402 fatcat:b2tiwkuyf5hzrfkst2oesitn74

CSIRO at 2019 TREC Precision Medicine Track

Maciej Rybinski, Sarvnaz Karimi, Cécile Paris
2019 Text Retrieval Conference  
TREC Precision Medicine track focuses on search tasks tailored for oncologists.  ...  The top row shows TREC Median results on 63 runs submitted by different teams for the scientific literature sub-task as reported in the TREC Overview [9] .  ...  Our models are trained directly on TREC PM 2017/2018 relevance judgements.  ... 
dblp:conf/trec/RybinskiKP19 fatcat:x5bnzzsq2bfexgwrqte4dymkqi

CENTRE@CLEF2019: Overview of the Replicability and Reproducibility Tasks

Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff
2019 Conference and Labs of the Evaluation Forum  
Note that the TREC 2017 Common Core Track topics are an updated version of the TREC 2004 Robust track topics.  ...  -Runs: WCrobust04 and WCrobust0405 [18] • Task Type: TREC 2017 Common Core Track [2] • Replicability: New York Times Annotated Corpus, with TREC 2017 Common Core Topics Since these runs were not originally  ... 
dblp:conf/clef/0001FMSS19 fatcat:e4l7oosuhvfhtofly45w6s4mau

TREC 2017 Precision Medicine - Medical University of Graz

Pablo López-García, Michel Oleynik, Zdenko Kasác, Stefan Schulz
2017 Text Retrieval Conference  
In this paper we report on our participation in the TREC 2017 Precision Medicine track (team name: imi_mug ).  ...  Our results showed that a modern search engine with an advanced query language is a powerful solution for the proposed tasks but it requires deep medical knowledge and careful tuning to get top performance  ...  INTRODUCTION The goal of the TREC 2017 Precision Medicine track was to improve search for clinicians treating cancer patients.  ... 
dblp:conf/trec/Lopez-GarciaOK017 fatcat:bkofgcobhnfopnw6lj5azg3td4

Overview of the TREC 2018 Precision Medicine Track

Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar
2018 Text Retrieval Conference  
This started with the TREC 2017 Precision Medicine track and continued with the 2018 track described here.  ...  Then, starting in 2017, the TREC Precision Medicine (Roberts et al., 2017) track grew from the CDS track, focusing on a more narrow problem domain (precision oncology).  ... 
dblp:conf/trec/RobertsDVHBL18 fatcat:pxcvu5tkirfwdcrg2o5vvmo5vy

TREC: An overview

Donna K. Harman, Ellen M. Voorhees
2007 Annual Review of Information Science and Technology  
In this paper we provide an overview of the TREC 2017 OpenSearch track.  ...  The OpenSearch track provides researchers the opportunity to have their retrieval approaches evaluated in a live setting with real users.  ...  Acknowledgments We would like to thank Anne Schuth and Peter Dekker for their help in developing and setting up the infrastructure for TREC OpenSearch.  ... 
doi:10.1002/aris.1440400111 fatcat:mkxft5upr5bkbbb3bf4qd2xnou

TUA1 at the TREC 2019: Deep Learning Track

Yun Gao, Xin Kang, Fuji Ren, Haitao Yu
2019 Text Retrieval Conference  
This paper details our participation in the TREC 2019 Deep Learning Track task including Passage Ranking task.  ...  In order to get a better ranking result, we divided the task into two stages.  ...  For detailed introductory information of this subtask, please refer to the task homepage 1 , the TREC Tracks homepage 2 , and the overview of the TREC 2019 Deep Learning Paper [Craswell et al., 2019]  ... 
dblp:conf/trec/GaoKRY19 fatcat:uueuxommajc6ppqbyjjduqpvoe

TREC 2018 News Track Overview

Ian Soboroff, Shudong Huang, Donna Harman
2018 Text Retrieval Conference  
The News track is a new track for TREC 2019, focused on information retrieval in the service of helping people read the news.  ...  roughly 38% of Americans got their news online, with the fraction increasing for younger consumers, 2 and in 2018 93% of American adults get at least some of their news online. 3 Pew further found in 2017  ...  Data The data for the News track is the TREC Washington Post Collection. 5 This collection contains five years of articles, from 2012 to 2017.  ... 
dblp:conf/trec/SoboroffHH18 fatcat:s5cjkm6n3rhvvonygd3ziiupmu

Report on the Second SIGIR Workshop on Neural Information Retrieval (Neu-IR'17)

Nick Craswell, W. Bruce Croft, Maarten de Rijke, Jiafeng Guo, Bhaskar Mitra
2018 SIGIR Forum  
Organizers of four of the TREC 2017 tracks were invited to present at the workshop on how these IR tasks may be suitable for evaluating recent data-hungry neural approaches.  ...  The second SIGIR workshop on neural information retrieval (Neu-IR'17) took place on August 11, 2017, in Tokyo, Japan.  ...  All accepted papers were presented as posters, and six papers-two from the special track TREC talks Organizers of four TREC 2017 tracks were invited to come present at the workshop.  ... 
doi:10.1145/3190580.3190603 fatcat:23pwl6jtnbdh3ifxexlwqozdhu

Overview of the TREC 2019 Precision Medicine Track

Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, Shubham Pant, Funda Meric-Bernstam
2019 Text Retrieval Conference  
This started with the TREC 2017 Precision Medicine track, continued in 2018, and further continues with the 2019 track described here.  ...  Then, the TREC Precision Medicine track grew from the CDS track, starting in 2017 (Roberts et al., 2017) and continuing in 2018 (Roberts et al., 2018) , focusing on a more narrow problem domain (precision  ... 
dblp:conf/trec/RobertsDVHBLPM19 fatcat:z57hhfbvnnfexkawpix5zap5xe

Overview of the CLEF 2017 Personalised Information Retrieval Pilot Lab (PIR-CLEF 2017) [chapter]

Gabriella Pasi, Gareth J. F. Jones, Stefania Marrara, Camilla Sanvitto, Debasis Ganguly, Procheta Sen
2017 Lecture Notes in Computer Science  
The PIR-CLEF 2017 Pilot Task is the first evaluation benchmark based on the Cranfield paradigm, with the potential benefits of producing evaluation results that are easily reproducible.  ...  The PIR-CLEF 2017 Lab provides a preliminary pilot edition of a Lab task dedicated to personalised search, while the workshop at the conference is intended to provide a forum for the discussion of strategies  ...  Overview of the PIR-CLEF 2017 Pilot Task The goal of the PIR-CLEF 2017 Pilot Task was to investigate the use of a laboratory-based method to enable a comparative evaluation of PIR.  ... 
doi:10.1007/978-3-319-65813-1_29 fatcat:ygtmjs5c5zbhvjj63vjvu6kiou

Overview of the Medical Question Answering Task at TREC 2017 LiveQA

Asma Ben Abacha, Eugene Agichtein, Yuval Pinter, Dina Demner-Fushman
2017 Text Retrieval Conference  
We present an overview of the medical question answering task organized at the TREC 2017 LiveQA track. The task addresses the automatic answering of consumer health questions received by the U.S.  ...  The medical task received eight runs from five participating teams.  ...  Introduction The LiveQA track at TREC started in 2015 [2] focusing on answering user questions in real time. The medical QA task was introduced in 2017 based on questions received by the U.S.  ... 
dblp:conf/trec/AbachaAPD17 fatcat:44j4ml5chrdqnfajnk2673kfdq

DUTIR at TREC 2019: Precision Medicine Track

Jingkun Feng, Zhihao Yang, Zhiqiang Liu, Ling Luo, Hongfei Lin, Jian Wang
2019 Text Retrieval Conference  
This paper describes the system developed for the TREC 2019 Precision Medicine Track by the Team DUTIR from Dalian University of Technology.  ...  Then we trained several deep models using TREC 2017 PM data. Finally, we applied the pre-trained models to reorder the initial search results.  ...  The overview of system for scientific abstracts task Table 2 .  ... 
dblp:conf/trec/FengYLLLW19 fatcat:aiarmr7kljgpthvtqaewosfvra
« Previous Showing results 1 — 15 out of 684 results