590 Hits in 2.4 sec

The Scholarly Impact of CLEF (2000–2009) [chapter]

Theodora Tsikrika, Birger Larsen, Henning Müller, Stefan Endrullis, Erhard Rahm
2013 Lecture Notes in Computer Science  
This paper assesses the scholarly impact of the CLEF evaluation campaign by performing a bibliometric analysis of the citations of the CLEF 2000-2009 proceedings publications collected through Scopus and  ...  Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest.  ...  This work was partially supported by the ELIAS ESF Research Networking Programme, and by the Promise (258191) and Khresmoi (257528) FP7 projects.  ... 
doi:10.1007/978-3-642-40802-1_1 fatcat:533ffulnnbcedphg33kgobcney

CLEF 2017 Dynamic Search Evaluation Lab Overview [chapter]

Evangelos Kanoulas, Leif Azzopardi
2017 Lecture Notes in Computer Science  
, simulations methods, and current evaluation metrics.  ...  Herein, we describe the overall objectives of the CLEF 2017 Dynamic Search Lab, the resources created for the pilot task, the evaluation methodology adopted, and some preliminary evaluation results of  ...  Acknowledgements This work was partially supported by the Google Faculty Research Award program and the Microsoft Azure for Research Award program (CRM:0518163).  ... 
doi:10.1007/978-3-319-65813-1_31 fatcat:bczfn7xtvbgivgyppwm7ka7xxy

CLEF 2012

Tiziana Catarci, Nicola Ferro, Pamela Forner, Djoerd Hiemstra, Jussi Karlgren, Anselmo Peñas, Giuseppe Santucci, Christa Womser-Hacker
2012 SIGIR Forum  
Acknowledgments The success of CLEF 2012 would not have been possible without the invaluable contributions of all the members of the Program Committee, Organizing Committee, students and volunteers that  ...  Finally, we would like to express our gratitude to the following sponsoring organizations for their significant and timely support: ELIAS Research Network Programme, Quaero, PROMISE Network of Excellence  ...  applications; (ii) specifying suitable evaluation methodologies and metrics; and (iii) developing of test collections that enable systematic comparison of algorithms and reliable benchmarking of commercial  ... 
doi:10.1145/2422256.2422261 fatcat:yv3w4ozkg5fsbf5hkd6bayuj64

CLEF 15th Birthday

Nicola Ferro
2014 SIGIR Forum  
This paper provides a summary of the motivations which led to the establishment of CLEF, and a description of how it has evolved over the years, the major achievements, and what we see as the next challenges  ...  2014 marks the 15 th birthday for CLEF, an evaluation campaign activity which has applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal information access systems in Europe  ...  Acknowledgements CLEF would not be possible without all the effort, enthusiasm, and passion of its community: lab organizers, lab participants, and attendees are the core and the real success of CLEF.  ... 
doi:10.1145/2701583.2701587 fatcat:exd4r3qlznhqhm77efsyof5gee

How robust are multilingual information retrieval systems?

Thomas Mandl, Christa Womser-Hacker, Giorgio Di Nunzio, Nicola Ferro
2008 Proceedings of the 2008 ACM symposium on Applied computing - SAC '08  
This paper analyzes a large amount of evaluation experiments from the Cross Language Evaluation Forum (CLEF).  ...  Robustness can be interpreted as stressing the importance of difficult topics and is usually measured with the geometric mean of the topic results.  ...  These collections contain documents in six languages (Dutch, English, German, French, Italian and Spanish) and were used almost constantly during CLEF 2001, CLEF 2002 and CLEF 2003.  ... 
doi:10.1145/1363686.1363949 dblp:conf/sac/MandlWNF08 fatcat:lpeokm4nfvbbbew2l3dqza5ng4

UniNE at CLEF 2016: Author Clustering

Mirco Kocher
2016 Conference and Labs of the Evaluation Forum  
The evaluations are based on six test collections (PAN AUTHOR CLUSTERING task at CLEF 2016).  ...  The suggested strategy can be adapted without any problem to different languages (such as Dutch, English, and Greek) in different genres (e.g., newspaper articles and reviews).  ...  Each collection consists of three sets of problems and we report the average of them. The final score is the mean between the two reported metrics.  ... 
dblp:conf/clef/Kocher16 fatcat:gjzq7mxtgzgafedwnthqguwrve

CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum

Nicola Ferro
2010 NTCIR Conference on Evaluation of Information Access Technologies  
the first time in CLEF 2010, and it will discuss some future perspective for CLEF, beyond 2010.  ...  This paper will provide a brief summary of the most significant results achieved by CLEF in the past ten years, it will describe the new format and organization for CLEF which is being experimented for  ...  CLEF 2010 is characterised by: • basement: the conference aimed at advancing the evaluation of multilingual and multimedia information systems, the evaluation methodologies and metrics developed to embody  ... 
dblp:conf/ntcir/Ferro10 fatcat:xn5ttzldifbevbvvr3jszzelhi

CLEF: Ongoing Activities and Plans for the Future

Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro, Carol Peters
2007 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes the evolution of CLEF over the last seven years, illustrates the main results, and provides some recommendations for future work in this area.  ...  Multilingual information access and crosslanguage search and retrieval are key issues for digital libraries.  ...  retrieval (iCLEF) CLEF 2002 [added] • cross-language spoken document retrieval (CL-SR) CLEF 2003 [added] • multiple language question answering (QA@CLEF) • cross-language retrieval in image collections  ... 
dblp:conf/ntcir/AgostiNFP07 fatcat:rdf2rg7r2ra5xec24qd6yv66j4

Comparative Evaluation of Cross-language Information Retrieval Systems [chapter]

Carol Peters
2005 Lecture Notes in Computer Science  
the research community with an infrastructure for testing and evaluating systems operating in multilingual contexts and a common platform for the comparison of methodologies and results.  ...  In this paper, we outline the various activities initiated by CLEF over the years in order to meet the emerging needs of the application communities, and trace the impact of these activities on advances  ...  CLEF 2000 and 2001 were sponsored by the 5FP DELOS Network of Excellence for Digital Libraries; CLEF 2002 and 2003 were funded as an independent project by the European Commission under the IST programme  ... 
doi:10.1007/978-3-540-31842-2_16 fatcat:4ad3pwr6pnhr5n6v3gwzsqd4cu

Scalable Multilingual Information Access [chapter]

Paul McNamee, James Mayfield
2003 Lecture Notes in Computer Science  
The third Cross-Language Evaluation Forum workshop (CLEF-2002) provides the unprecedented opportunity to evaluate retrieval in eight different languages using a uniform set of topics and assessment methodology  ...  We contend that information access in a plethora of languages requires approaches that are inexpensive in developer and run-time costs.  ...  Introduction The number of languages in the CLEF document collection has grown to eight in 2002: Dutch, English, Finnish, French, German, Italian, Spanish, and Swedish.  ... 
doi:10.1007/978-3-540-45237-9_17 fatcat:6wihlivr3jf4zkcx4u3puphjey

10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go

Maristella Agosti, Giorgio Maria Di Nunzio, Marco Dussin, Nicola Ferro
2010 NTCIR Conference on Evaluation of Information Access Technologies  
This paper discusses the evolution of large-scale evaluation campaigns and the corresponding evaluation infrastructures needed to carry them out.  ...  We present the next challenges for these initiatives and show how digital library systems can play a relevant role in supporting the research conducted in these fora by acting as virtual research environments  ...  ACKNOWLEDGMENTS The authors would like to warmly thank Carol Peters for her continuous support and advice.  ... 
dblp:conf/ntcir/AgostiNDF10 fatcat:swtcyahksrec5hz7rzmn4za4na

Overview of the CLEF Dynamic Search Evaluation Lab 2018 [chapter]

Evangelos Kanoulas, Leif Azzopardi, Grace Hui Yang
2018 Lecture Notes in Computer Science  
Herein, we describe the overall objectives of the CLEF 2018 Dynamic Search Lab, the resources created, and the evaluation methodology designed.  ...  In this paper we provide an overview of the CLEF 2018 Dynamic Search Lab. The lab ran for the first time in 2017 as a workshop.  ...  All content represents the opinion of the authors, which is not necessarily shared or endorsed by their respective employers and/or sponsors.  ... 
doi:10.1007/978-3-319-98932-7_31 fatcat:hbwbpbngvfbexoif34prsout4i

What Happened in CLEF2009: Introduction to the Working Notes

Carol Peters
2009 Conference and Labs of the Evaluation Forum  
Appendices are also included containing run statistics for the Ad Hoc and Grid@CLEF tracks, and a list of all participating institutions.  ...  The results of the experiments will be presented and discussed in the CLEF 2009 Workshop, 30 September -2 October, Corfu, Greece.  ...  INFILE has extended the last filtering track of TREC 2002 as follows.  ... 
dblp:conf/clef/Peters09b fatcat:p5tpt2abovetffp3tjip2n3n6a

From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum

Nicola Ferro, Carol Peters
2008 NTCIR Conference on Evaluation of Information Access Technologies  
In the final part, we outline our main ideas for the future of CLEF.  ...  In the first part of the paper, we provide a brief overview of the entire activity and summarise the main achievements; in the second part, we focus our attention on the Ad Hoc track with the aim of showing  ...  Acknowledgements CLEF is organised on a distributed basis with different research groups being responsible for the running of the various tracks.  ... 
dblp:conf/ntcir/FerroP08 fatcat:h3p27ct6grgdnoe4sr52ce77va

A Shallow Approach for Answer Selection based on Dependency Trees and Term Density

Manuel Alberto Pérez-Coutiño, Manuel Montes-y-Gómez, Aurelio López-López, Luis Villaseñor Pineda, Aarón Pancardo-Rodríguez
2006 Conference and Labs of the Evaluation Forum  
This paper describes the experiments performed for the QA@CLEF-2006 within the joint participation of the eLing Division at VEng and the Language Technologies Laboratory at INAOE.  ...  Nevertheless, there are many variables to consider for a substantial improvement of the whole Question Answering system, and particularly at the initial steps, where passage retrieval and candidate answer  ...  We also like to thanks to the CLEF as well as EFE agency for the resources provided.  ... 
dblp:conf/clef/Perez-CoutinoMLPP06a fatcat:dr7kidn3cvhc5adabdky3xbezm
« Previous Showing results 1 — 15 out of 590 results