Filters








1,890 Hits in 2.9 sec

The Scholarly Impact of CLEF (2000–2009) [chapter]

Theodora Tsikrika, Birger Larsen, Henning Müller, Stefan Endrullis, Erhard Rahm
2013 Lecture Notes in Computer Science  
This paper assesses the scholarly impact of the CLEF evaluation campaign by performing a bibliometric analysis of the citations of the CLEF 2000-2009 proceedings publications collected through Scopus and  ...  Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest.  ...  Overview of the CLEF 2004 Multilingual QA Track. 2004 O Table 4 . 4 Relative percentages of different types of CLEF proceedings publications and their citations over the years 2000 2001 2002 2003 2004  ... 
doi:10.1007/978-3-642-40802-1_1 fatcat:533ffulnnbcedphg33kgobcney

Cross-language information retrieval: experiments based on CLEF 2000 corpora

Jacques Savoy
2003 Information Processing & Management  
providing the user with a single unique result list.  ...  Search engines play an essential role in the usability of Internet-based information systems and without them the Web would be much less accessible, and at the very least would develop at a much slower  ...  Overview of the test-collections One of the main outcomes of the first CLEF workshop was the creation of various testcollections that would be available in four different languages.  ... 
doi:10.1016/s0306-4573(02)00018-3 fatcat:ejqtaxrm5vcurbbjvmiicekpxe

Dictionary-Based Cross-Language Information Retrieval: Learning Experiences from CLEF 2000–2002

Turid Hedlund, Eija Airio, Heikki Keskustalo, Raija Lehtokangas, Ari Pirkola, Kalervo Järvelin
2004 Information retrieval (Boston)  
In this study the basic framework and performance analysis results are presented for the three year long development process of the dictionary-based UTACLIR system.  ...  The results and the fault analysis have been valuable in the development process. Overall the results indicate that the process is robust and can be extended to other languages.  ...  Figure 1 gives an overview of the external resources and main system components of UTACLIR.  ... 
doi:10.1023/b:inrt.0000009442.34054.55 fatcat:6mucmegfgnbgrbgfjhfq22hgzq

CLEF 15th Birthday

Nicola Ferro
2014 SIGIR Forum  
This paper provides a summary of the motivations which led to the establishment of CLEF, and a description of how it has evolved over the years, the major achievements, and what we see as the next challenges  ...  2014 marks the 15 th birthday for CLEF, an evaluation campaign activity which has applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal information access systems in Europe  ...  We would like to sincerely and warmly thank Maristella Agosti, Donna Harman, and Carol Peters (Coordinator of CLEF 2000-2009) for their precious and continuous advice and suggestions during this journey  ... 
doi:10.1145/2701583.2701587 fatcat:exd4r3qlznhqhm77efsyof5gee

The CLEF 2001 Interactive Track [chapter]

Douglas W. Oard, Julio Gonzalo
2002 Lecture Notes in Computer Science  
This paper describes the shared experiment design used at all three participating sites, summarizes preliminary results from the evaluation, and concludes with observations on lessons learned that can  ...  inform the design of subsequent evaluation campaigns.  ...  We used top-1000 results from John Hopkins University for English documents (found for CLEF 2000 using French queries) and from University of Maryland for French documents (found after CLEF 2000 using  ... 
doi:10.1007/3-540-45691-0_30 fatcat:gtwzsx4kfbavnd6pyfh6pgeuxu

Combination Approaches for Multilingual Text Retrieval

Martin Braschler
2004 Information retrieval (Boston)  
We discuss the implications of building a system that allows flexible combination, give details of the various translation resources and methods, and investigate the impact of merging intermediate results  ...  An analysis of the resulting combination system is given which also takes into account additional requirements when deploying the system as a component in an operational, commercial setting.  ...  Acknowledgments Peter Schäuble, Bärbel Ripplinger and Anne Göhring were involved in planning and conducting the Eurospider participation in the three CLEF campaigns.  ... 
doi:10.1023/b:inrt.0000009445.19495.46 fatcat:qzdsergfjncdtfjstub4usp7vm

Building Strategies, a Year Later

Wouter Alink, Roberto Cornacchia, Arjen P. de Vries
2010 Conference and Labs of the Evaluation Forum  
The CLEF IP 2010 PAC task enabled us to correct some experiments and obtain better results, basically using the same techniques (almost the same BM25-category strategy as used last year) and improved strategy  ...  The results are now comparable with other participants.  ...  Creating a full run over 2000 topics took about 12 hours. A SQL dump of the resulting database is roughly 300GB uncompressed in size (81GB bzipped).  ... 
dblp:conf/clef/AlinkCV10 fatcat:xevotlz2kjal7ltrcjnrpiby2a

What happened in CLEF 2007: Introduction to the Working Notes

Carol Peters
2007 Conference and Labs of the Evaluation Forum  
The final papers -revised and extended as a result of the discussions at the Workshop -together with a comparative analysis of the results will appear in the CLEF 2007 Proceedings, to be published by Springer  ...  The results of the experiments will be presented and discussed in the CLEF 2007 Workshop, 19-21 September, Budapest, Hungary.  ...  CLEF 2000 -2007: Variation in Participation Table 1 : Sources and dimensions of the CLEF 2007 multilingual comparable corpus 1 Collection Added in Size No. of Docs Median Size Median Size Median Size  ... 
dblp:conf/clef/Peters07a fatcat:ppojwxr4dzga3m7anoqmavsmuu

The effect of named entities on effectiveness in cross-language information retrieval evaluation

Thomas Mandl, Christa Womser-Hacker
2005 Proceedings of the 2005 ACM symposium on Applied computing - SAC '05  
Acknowledgements • We thank Martin Braschler for providing the CLEF data in digital format • Part of this work was supported by a grant from the German Research Foundation (DFG) Download this presentation  ...  number of named entities Number of topics CLEF year 1.44 72 50 2004 1.62 97 60 2003 1.72 86 50 2002 1.20 60 50 2001 1.30 52 40 2000 Analyzed Runs (examples) CLEF year  ...  for the exchange of experiences and ideas -transfer research into applications http://www.clef-campaign.org Cross-Language Evaluation Forum Results of CLEF -Effective approaches for individual  ... 
doi:10.1145/1066677.1066919 dblp:conf/sac/MandlW05 fatcat:jfkpcqfccjh6vej7i3cl72bv5y

Domain Specific Retrieval Experiments with MIMOR at the University of Hildesheim [chapter]

René Hackl, Ralph Kölle, Thomas Mandl, Christa Womser-Hacker
2003 Lecture Notes in Computer Science  
The linear combination of several retrieval engines was optimized. As a basic retrieval engine, IRF from NIST was employed. The results are promising.  ...  For our first participation in CLEF we chose the domain specific GIRT corpus.  ...  Furthermore, we acknowledge the work of several students from the University of Hildesheim who implemented MIMOR as part of their course work.  ... 
doi:10.1007/978-3-540-45237-9_30 fatcat:uuw2majlojcfjnsszgbwl5g2gy

CLEF 2012

Tiziana Catarci, Nicola Ferro, Pamela Forner, Djoerd Hiemstra, Jussi Karlgren, Anselmo Peñas, Giuseppe Santucci, Christa Womser-Hacker
2012 SIGIR Forum  
Acknowledgments The success of CLEF 2012 would not have been possible without the invaluable contributions of all the members of the Program Committee, Organizing Committee, students and volunteers that  ...  , Sapienza "University of Rome"  ...  Since 2000 the Cross-Language Evaluation Forum (CLEF) has played a leading role in stimulating research and innovation in a wide range of key areas in the domain of information retrieval.  ... 
doi:10.1145/2422256.2422261 fatcat:yv3w4ozkg5fsbf5hkd6bayuj64

From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum

Nicola Ferro, Carol Peters
2008 NTCIR Conference on Evaluation of Information Access Technologies  
The Cross-Language Evaluation Forum (CLEF) has been running for nearly ten years now; the aim of this paper is to provide a critical assessment of the results achieved so far.  ...  In the final part, we outline our main ideas for the future of CLEF.  ...  Acknowledgements CLEF is organised on a distributed basis with different research groups being responsible for the running of the various tracks.  ... 
dblp:conf/ntcir/FerroP08 fatcat:h3p27ct6grgdnoe4sr52ce77va

Cross-Language Evaluation Forum: Objectives, Results, Achievements

Martin Braschler, Carol Peters
2004 Information retrieval (Boston)  
The Cross-Language Evaluation Forum (CLEF) is now in its fourth year of activity.  ...  We summarize the main lessons learned during this period, outline the state-of-the-art of the research reported in the CLEF experiments and discuss the contribution that this initiative has made to research  ...  CLEF is an activity conducted by the CLEF project consortium, of which the two authors are but two members.  ... 
doi:10.1023/b:inrt.0000009438.69013.fa fatcat:pu7xyyfwkzhjdh7wptsn3qsuce

Combining Evidence for Cross-Language Information Retrieval [chapter]

Jaap Kamps, Christof Monz, Maarten de Rijke
2003 Lecture Notes in Computer Science  
This paper describes the official runs of our team for CLEF 2002.  ...  We took part in the monolingual tasks for each of the seven non-English languages for which CLEF provides document collections (Dutch, Finnish, French, German, Italian, Spanish, and Swedish).  ...  On our pre-submission experiments on the GIRT topics of CLEF 2000 and CLEF 2001, we also noticed a drop in performance, but far less dramatic than for the CLEF 2002 run (average precision around 0.31 for  ... 
doi:10.1007/978-3-540-45237-9_9 fatcat:prfk33uno5b6ra4bzatq5gv42y

UTACLIR @ CLEF 2001: New Features for Handling Compound Words and Untranslatable Proper Names

Turid Hedlund, Heikki Keskustalo, Ari Pirkola, Eija Airio, Kalervo Järvelin
2001 Conference and Labs of the Evaluation Forum  
The results for all the four runs are good. Average precision for all the queries shows clear improvements. For German -English we have tested two types of dictionaries (two runs).  ...  We participated in CLEF'2001 with four automated bilingual runs. UTACLIR is an automatic query translation and construction system for cross-language information retrieval.  ...  An overview of the new UTACLIR process is in Figure 1 .  ... 
dblp:conf/clef/HedlundKPAJ01a fatcat:pfpz7m4ipvbjfa74n6ryznju2e
« Previous Showing results 1 — 15 out of 1,890 results