Filters








828 Hits in 5.8 sec

The Multiple Language Question Answering Track at CLEF 2003 [chapter]

Bernardo Magnini, Simone Romagnoli, Alessandro Vallin, Jesús Herrera, Anselmo Peñas, Víctor Peinado, Felisa Verdejo, Maarten de Rijke
2004 Lecture Notes in Computer Science  
This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year.  ...  The track was divided into monolingual and bilingual tasks: monolingual systems were evaluated within the frame of three non-English European languages, Dutch, Italian and Spanish, while in the crosslanguage  ...  pilot track.  ... 
doi:10.1007/978-3-540-30222-3_46 fatcat:kdstrb2wevh5zoucn7iumibze4

Comparative Evaluation of Cross-language Information Retrieval Systems [chapter]

Carol Peters
2005 Lecture Notes in Computer Science  
In recognition of this, five years ago, the DELOS Network for Digital Libraries launched the Cross-Language Evaluation Forum (CLEF), with the objective of promoting multilingual information access by providing  ...  In this paper, we outline the various activities initiated by CLEF over the years in order to meet the emerging needs of the application communities, and trace the impact of these activities on advances  ...  This task was the interactive counterpoint to the fully automatic cross-language question-answering task in CLEF 2003 and 2004 [10] .  ... 
doi:10.1007/978-3-540-31842-2_16 fatcat:4ad3pwr6pnhr5n6v3gwzsqd4cu

Introduction to the CLEF2013 Labs and Workshop

Roberto Navigli, Dan Tufis
2013 Conference and Labs of the Evaluation Forum  
ImageCLEF 2013 -Cross Language Image Annotation and Retrieval The main goal of ImageCLEF, which started in 2003, is supporting the development of visual media analysis, indexing, classification, and retrieval  ...  The CLEF 2013 conference is a new edition of the popular CLEF campaign and workshop series which has run since 2000 contributing to the systematic evaluation of information access systems, primarily through  ...  the proposals during the selection process: Jussi Karlgren, Gavagai and SICS (CLEF LOC 2012 co-chair) Christa Womser-Hacker, Universität Hildesheim (CLEF LOC 2012 co-chair) We also thank all the proposal  ... 
dblp:conf/clef/NavigliT13 fatcat:kg76ulv4inf2jhfzxbqfsqywzm

What happened in CLEF 2007: Introduction to the Working Notes

Carol Peters
2007 Conference and Labs of the Evaluation Forum  
The final papers -revised and extended as a result of the discussions at the Workshop -together with a comparative analysis of the results will appear in the CLEF 2007 Proceedings, to be published by Springer  ...  Both Working Notes and Book of Abstracts are divided into eight sections, corresponding to the CLEF 2007 evaluation tracks, plus an additional section describing other evaluation initiatives using CLEF  ...  mono-and cross-language information on structured scientific data (Domain-Specific) • multiple language question answering (QA@CLEF) • cross-language retrieval in image collections (ImageCLEF) • cross-language  ... 
dblp:conf/clef/Peters07a fatcat:ppojwxr4dzga3m7anoqmavsmuu

CLEF: Ongoing Activities and Plans for the Future

Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro, Carol Peters
2007 NTCIR Conference on Evaluation of Information Access Technologies  
For this reason, DELOS has continued to support the activities of the Cross-Language Evaluation Forum (CLEF), which has the promotion of research in multilingual information retrieval system development  ...  This paper describes the evolution of CLEF over the last seven years, illustrates the main results, and provides some recommendations for future work in this area.  ...  Acknowledgements The work reported in this paper has been partially supported by the DELOS Network of Excellence on Digital Libraries, as part of the Information Society Technologies (IST) Program of the  ... 
dblp:conf/ntcir/AgostiNFP07 fatcat:rdf2rg7r2ra5xec24qd6yv66j4

What Happened in CLEF 2006: Introduction to the Working Notes

Carol Peters
2006 Conference and Labs of the Evaluation Forum  
Both Working Notes and Book of Abstracts are divided into eight sections, corresponding to the CLEF 2006 evaluation tracks.  ...  This is done through the organisation of annual evaluation campaigns in which a series of tracks designed to test different aspects of mono-and cross-language information retrieval (IR) are offered.  ...  Multilingual Question Answering (QA@CLEF): This track, which has received increasing interest at CLEF since 2003, evaluated both monolingual (non-English) and cross-language QA systems.  ... 
dblp:conf/clef/Peters06a fatcat:x2we7dsuurdezntkuqqpjbstqe

Cross-Language Evaluation Forum: Objectives, Results, Achievements

Martin Braschler, Carol Peters
2004 Information retrieval (Boston)  
The Cross-Language Evaluation Forum (CLEF) is now in its fourth year of activity.  ...  We summarize the main lessons learned during this period, outline the state-of-the-art of the research reported in the CLEF experiments and discuss the contribution that this initiative has made to research  ...  CLEF itself started its "life" as a track organized within the TREC framework.  ... 
doi:10.1023/b:inrt.0000009438.69013.fa fatcat:pu7xyyfwkzhjdh7wptsn3qsuce

The DIOGENE Question Answering System at CLEF-2004 [chapter]

Hristo Tanev, Matteo Negri, Bernardo Magnini, Milen Kouylekov
2005 Lecture Notes in Computer Science  
QA track at CLEF-2004.  ...  This paper presents the ITC-irst Multilingual Question Answering system DIOGENE. The system was used successfully on the CLEF-2003, TREC-2003, TREC-2002 and TREC-2001.  ...  Answer Validation. In CLEF-2003 we used AltaVista for answer validation.  ... 
doi:10.1007/11519645_43 fatcat:gdr76ig6d5fizagc5flfilhjcu

From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum

Nicola Ferro, Carol Peters
2008 NTCIR Conference on Evaluation of Information Access Technologies  
The Cross-Language Evaluation Forum (CLEF) has been running for nearly ten years now; the aim of this paper is to provide a critical assessment of the results achieved so far.  ...  In the final part, we outline our main ideas for the future of CLEF.  ...  Acknowledgements CLEF is organised on a distributed basis with different research groups being responsible for the running of the various tracks.  ... 
dblp:conf/ntcir/FerroP08 fatcat:h3p27ct6grgdnoe4sr52ce77va

Bridging Languages for Question Answering: DIOGENE at CLEF 2003 [chapter]

Matteo Negri, Hristo Tanev, Bernardo Magnini
2004 Lecture Notes in Computer Science  
The overall architecture of the extended system, as well as the results obtained in the CLEF-2003 Monolingual Italian and Bilingual Italian/English QA tracks will be presented and discussed throughout  ...  This paper presents the extension of the ITC-irst DIOGENE Question Answering system towards multilinguality.  ...  The results achieved at the CLEF-2003 Multiple Language QA task confirm the effectiveness of our approach: both the Italian and the Italian/English version of DIOGENE performed well, producing results  ... 
doi:10.1007/978-3-540-30222-3_48 fatcat:mhyrt4nxzvaptcicicyfsemnsq

What Happened in CLEF2009: Introduction to the Working Notes

Carol Peters
2009 Conference and Labs of the Evaluation Forum  
The Working Notes for all the ten CLEF campaigns can be found in electronic form on the CLEF website at www.clef-campaign.org.  ...  This is done through the organisation of annual evaluation campaigns in which a series of tracks designed to test different aspects of mono-and cross-language information retrieval (IR) are offered.  ...  Multilingual Question Answering (QA@CLEF): This track has offered monolingual and cross-language question answering tasks since 2003.  ... 
dblp:conf/clef/Peters09b fatcat:p5tpt2abovetffp3tjip2n3n6a

Creating the DISEQuA Corpus: A Test Set for Multilingual Question Answering [chapter]

Bernardo Magnini, Simone Romagnoli, Alessandro Vallin, Jesús Herrera, Anselmo Peñas, Víctor Peinado, Felisa Verdejo, Maarten de Rijke
2004 Lecture Notes in Computer Science  
This paper describes the procedure adopted by the three co-ordinators of the CLEF 2003 question answering track (ITC-irst, UNED and ILLC) to create the question set for the monolingual tasks.  ...  Despite the little resources available, the three groups collaborated and managed to formulate and verify a large pool of original questions posed in three different languages: Dutch, Italian and Spanish  ...  We are also indebted to Franca Rossi and Elisabetta Fauri at ITC-irst, for their help in the verification of the questions.  ... 
doi:10.1007/978-3-540-30222-3_47 fatcat:nfaayaegkfhgpmfywcmwolbw3u

DFKI's LT-lab at the CLEF 2005 Multiple Language Question Answering Track

Günter Neumann, Bogdan Sacaleanu
2005 Conference and Labs of the Evaluation Forum  
This report describes the work done by the QA group of the Language Technology Lab at DFKI for the 2005 edition of the Cross-Language Evaluation Forum (CLEF).  ...  We describe the extensions made to our 2004 QA@CLEF German/English QA-system, especially the question-type driven selection of answer strategies.  ...  Many thanks to Rob Basten for his support in the development of the component for handling temporally restricted questions, Yuan Ye for his support in data collection and annotation for the definition  ... 
dblp:conf/clef/NeumannS05b fatcat:j2jpp55sqre2xd5miyp3azfbxe

Cross-Language Information Retrieval: the way ahead

Fredric C. Gey, Noriko Kando, Carol Peters
2005 Information Processing & Management  
This introductory paper covers not only the research content of the articles in this special issue of IP&M but attempts to characterize the state-of-the-art in the Cross-Language Information Retrieval  ...  In particular, we find that insufficient attention has been given to the Web as a resource for multilingual research, and to languages which are spoken by hundreds of millions of people in the world but  ...  track at CLEF.  ... 
doi:10.1016/j.ipm.2004.06.006 fatcat:xy2zdmzd2ffy5op7wxlrd4avkq

What happened in CLEF 2008: Introduction to the Working Notes

Carol Peters
2008 Conference and Labs of the Evaluation Forum  
The following institutions have contributed to the organisation of the different tracks of the CLEF 2008 campaign:  ...  The final papers -revised and extended as a result of the discussions at the Workshop -together with a comparative analysis of the results will appear in the CLEF 2008 Proceedings, to be published by Springer  ...  Acknowledgements CLEF Steering Committee  ... 
dblp:conf/clef/Peters08a fatcat:sguzidsq25hincctifanop2sz4
« Previous Showing results 1 — 15 out of 828 results