Filters








218 Hits in 4.9 sec

Overview of the CLEF 2004 Multilingual Question Answering Track [chapter]

Bernardo Magnini, Alessandro Vallin, Christelle Ayache, Gregor Erbach, Anselmo Peñas, Maarten de Rijke, Paulo Rocha, Kiril Simov, Richard Sutcliffe
2005 Lecture Notes in Computer Science  
The general aim of the third CLEF Multilingual Question Answering Track was to set up a common and replicable evaluation framework to test both monolingual and cross-language Question Answering (QA) systems  ...  We provide an overview of the 2005 QA track, detail the procedure followed to build the test sets and present a general analysis of the results.  ...  Conclusions This paper presented the Multilingual Question Answering evaluation campaign organized at CLEF 2005.  ... 
doi:10.1007/11519645_38 fatcat:odzpsiwi2vhcdfmksgdi2lh6dq

Page 60 of Computational Linguistics Vol. 33, Issue 1 [page]

2007 Computational Linguistics  
Overview of the CLEF 2005 multilingual question answering track. In Proceedings of CLEF 2005, Vienna, Austria. Vargas-Vera, Maria and Enrico Motta. 2004.  ...  The TREC-8 question answering track report. In Proc eedings of TREC-8, pages 77-82, Gaithersburg, MD. Voorhees, Ellen M. 2001. The TREC question answering track.  ... 

What happened in CLEF 2007: Introduction to the Working Notes

Carol Peters
2007 Conference and Labs of the Evaluation Forum  
Both Working Notes and Book of Abstracts are divided into eight sections, corresponding to the CLEF 2007 evaluation tracks, plus an additional section describing other evaluation initiatives using CLEF  ...  The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development.  ...  This track was coordinated by IZ Bonn (Germany). Multilingual Question Answering (QA@CLEF): QA@CLEF 2007 proposed both main and pilot tasks.  ... 
dblp:conf/clef/Peters07a fatcat:ppojwxr4dzga3m7anoqmavsmuu

The DIOGENE Question Answering System at CLEF-2004 [chapter]

Hristo Tanev, Matteo Negri, Bernardo Magnini, Milen Kouylekov
2005 Lecture Notes in Computer Science  
QA track at CLEF-2004.  ...  DIOGENE CLEF-2004 architecture was similar to the CLEF-2003 version [Negri et.al. 2003]. A novel feature for the CLEF-2004 version is the answer extraction and validation via linguistic templates.  ...  CLEF-2004 QA track organizers stated in the guidelines that questions will be about persons and organizations.  ... 
doi:10.1007/11519645_43 fatcat:gdr76ig6d5fizagc5flfilhjcu

Cross-language Information Retrieval [article]

Petra Galuščáková, Douglas W. Oard, Suraj Nair
2022 arXiv   pre-print
This chapter reviews the state of the art for CLIR and outlines some open research questions.  ...  Two key assumptions shape the usual view of ranked retrieval: (1) that the searcher can choose words for their query that might appear in the documents that they wish to see, and (2) that ranking retrieved  ...  Overview of the CLEF 2004 mul- tilingual question answering track. In C. Peters, P. Clough, J. Gonzalo, G. J. F. Jones, M. Kluck, and B.  ... 
arXiv:2111.05988v2 fatcat:4f3qbtcswvdavhzhufehdlbyry

The Multiple Language Question Answering Track at CLEF 2003 [chapter]

Bernardo Magnini, Simone Romagnoli, Alessandro Vallin, Jesús Herrera, Anselmo Peñas, Víctor Peinado, Felisa Verdejo, Maarten de Rijke
2004 Lecture Notes in Computer Science  
This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year.  ...  We give here an overview of the track: we report on each task and discuss the creation of the multilingual test sets and the participants' results.  ...  pilot track.  ... 
doi:10.1007/978-3-540-30222-3_46 fatcat:kdstrb2wevh5zoucn7iumibze4

Cross-Language Evaluation Forum: Objectives, Results, Achievements

Martin Braschler, Carol Peters
2004 Information retrieval (Boston)  
The Cross-Language Evaluation Forum (CLEF) is now in its fourth year of activity.  ...  We summarize the main lessons learned during this period, outline the state-of-the-art of the research reported in the CLEF experiments and discuss the contribution that this initiative has made to research  ...  CLEF itself started its "life" as a track organized within the TREC framework.  ... 
doi:10.1023/b:inrt.0000009438.69013.fa fatcat:pu7xyyfwkzhjdh7wptsn3qsuce

CLEF 15th Birthday

Nicola Ferro
2014 SIGIR Forum  
2014 marks the 15 th birthday for CLEF, an evaluation campaign activity which has applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal information access systems in Europe  ...  This paper provides a summary of the motivations which led to the establishment of CLEF, and a description of how it has evolved over the years, the major achievements, and what we see as the next challenges  ...  Acknowledgements CLEF would not be possible without all the effort, enthusiasm, and passion of its community: lab organizers, lab participants, and attendees are the core and the real success of CLEF.  ... 
doi:10.1145/2701583.2701587 fatcat:exd4r3qlznhqhm77efsyof5gee

Overview of the CLEF 2005 Multilingual Question Answering Track [chapter]

Alessandro Vallin, Bernardo Magnini, Danilo Giampiccolo, Lili Aunimo, Christelle Ayache, Petya Osenova, Anselmo Peñas, Maarten de Rijke, Bogdan Sacaleanu, Diana Santos, Richard Sutcliffe
2006 Lecture Notes in Computer Science  
The general aim of the third CLEF Multilingual Question Answering Track was to set up a common and replicable evaluation framework to test both monolingual and cross-language Question Answering (QA) systems  ...  We provide an overview of the 2005 QA track, detail the procedure followed to build the test sets and present a general analysis of the results.  ...  Conclusions This paper presented the Multilingual Question Answering evaluation campaign organized at CLEF 2005.  ... 
doi:10.1007/11878773_36 fatcat:xmet2ayrajbllfv2w5azaq4wyu

Overview of the CLEF 2006 Multilingual Question Answering Track [chapter]

Bernardo Magnini, Danilo Giampiccolo, Pamela Forner, Christelle Ayache, Valentin Jijkoun, Petya Osenova, Anselmo Peñas, Paulo Rocha, Bogdan Sacaleanu, Richard Sutcliffe
2007 Lecture Notes in Computer Science  
The general aim of the third CLEF Multilingual Question Answering Track was to set up a common and replicable evaluation framework to test both monolingual and cross-language Question Answering (QA) systems  ...  We provide an overview of the 2005 QA track, detail the procedure followed to build the test sets and present a general analysis of the results.  ...  Conclusions This paper presented the Multilingual Question Answering evaluation campaign organized at CLEF 2005.  ... 
doi:10.1007/978-3-540-74999-8_31 fatcat:lilwqiqyqzbhfn6bal4jggdaoe

Overview of the CLEF 2005 Interactive Track [chapter]

Julio Gonzalo, Paul Clough, Alessandro Vallin
2006 Lecture Notes in Computer Science  
The CLEF Interactive Track (iCLEF) is devoted to the comparative study of userinclusive cross-language search strategies.  ...  In the interactive Question Answering task, users are asked to find the answer to a number of questions in a foreign-language document collection, and write the answers in their own native language.  ...  Acknowledgments We are indebted to Richard Sutcliffe and Christelle Ayache for taking care of the Q&A assessments; Victor Peinado and Fernando López for their assistance with submission processing, Javier  ... 
doi:10.1007/11878773_30 fatcat:aynnw5nxrffkvhlkdvzgjyenea

AnswerFinder at QA@CLEF 2007

Menno van Zaanen, Diego Mollá
2007 Conference and Labs of the Evaluation Forum  
The main purpose of our participation was to investigate the flexibility, portability, and scalability of the generic question answering system.  ...  Due to the nature and quality of the translated questions and the lack of tuning, we expected (and received) low quality results.  ...  To decide which of these systems would provide us with the best translation of the questions, we translated QA@CLEF questions of the 2004 and 2006 competitions.  ... 
dblp:conf/clef/ZaanenM07 fatcat:erebazxztrgdtjcb32uimq6q6a

The Scholarly Impact of CLEF (2000–2009) [chapter]

Theodora Tsikrika, Birger Larsen, Henning Müller, Stefan Endrullis, Erhard Rahm
2013 Lecture Notes in Computer Science  
This paper assesses the scholarly impact of the CLEF evaluation campaign by performing a bibliometric analysis of the citations of the CLEF 2000-2009 proceedings publications collected through Scopus and  ...  Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest.  ...  This work was partially supported by the ELIAS ESF Research Networking Programme, and by the Promise (258191) and Khresmoi (257528) FP7 projects.  ... 
doi:10.1007/978-3-642-40802-1_1 fatcat:533ffulnnbcedphg33kgobcney

20th Century Esfinge (Sphinx) Solving the Riddles at CLEF 2005 [chapter]

Luís Costa
2006 Lecture Notes in Computer Science  
This year, participation was intended to correct the basic errors of last year and work for the first time in the multilingual QA track.  ...  These patterns are queried in several text collections (CLEF text collections and the Web) to obtain snippets of text where the answers are likely to be found.  ...  multilingual task, but it was not possible to finish it in time to send it to the organization).  ... 
doi:10.1007/11878773_52 fatcat:ydrk2xsnzvg6hgpgwthes4afva

Bridging Languages for Question Answering: DIOGENE at CLEF 2003 [chapter]

Matteo Negri, Hristo Tanev, Bernardo Magnini
2004 Lecture Notes in Computer Science  
This paper presents the extension of the ITC-irst DIOGENE Question Answering system towards multilinguality.  ...  The overall architecture of the extended system, as well as the results obtained in the CLEF-2003 Monolingual Italian and Bilingual Italian/English QA tracks will be presented and discussed throughout  ...  The results achieved at the CLEF-2003 Multiple Language QA task confirm the effectiveness of our approach: both the Italian and the Italian/English version of DIOGENE performed well, producing results  ... 
doi:10.1007/978-3-540-30222-3_48 fatcat:mhyrt4nxzvaptcicicyfsemnsq
« Previous Showing results 1 — 15 out of 218 results