Filters








827 Hits in 4.9 sec

CLEF 2013

Nicola Ferro, Pamela Forner, Henning Müller, Roberto Navigli, Roberto Paredes, Paolo Rosso, Benno Stein, Dan Tufis
2013 SIGIR Forum  
Acknowledgments The success of CLEF 2013 would not have been possible without the contributions of the members of the Program Committee, the Organizing Committee, the students, and other volunteers who  ...  Yandex, Universitat Politècnica de València, Departamento Sistemas Informáticos y Computación (DSIC), Escola Técnica Superior d'Enginieria Informática (ETSINF), COREX, and the Web Information Quality Evaluation  ...  Number of participating teams: 46 QA4MRE -Question Answering for Machine Reading Evaluation Main goal of this lab is to develop a methodology for evaluating machine reading systems through question answering  ... 
doi:10.1145/2568388.2568392 fatcat:ezpo2wtb65cmrpjowvvnk3q374

Spanish Question Answering Evaluation [chapter]

Anselmo Peñas, Felisa Verdejo, Jesús Herrera
2004 Lecture Notes in Computer Science  
This paper reports the most significant issues related to the launching of a Monolingual Spanish Question Answering evaluation track at the Cross Language Evaluation Forum (CLEF 2003).  ...  It introduces some questions about multilingualism and describes the methodology for test suite production, task, judgment of answers as well as the results obtained by the participant systems.  ...  Next edition of the Multilingual Question Answering at CLEF will extend the multilingual tasks to any combination pairs between Spanish, Italian, Dutch, and possibly it will include also English, French  ... 
doi:10.1007/978-3-540-24630-5_58 fatcat:jqohsaxei5epnm4qavmuxbxwbe

Comparative Evaluation of Cross-language Information Retrieval Systems [chapter]

Carol Peters
2005 Lecture Notes in Computer Science  
in multilingual system development.  ...  In recognition of this, five years ago, the DELOS Network for Digital Libraries launched the Cross-Language Evaluation Forum (CLEF), with the objective of promoting multilingual information access by providing  ...  New types of questions (how-questions and definition type questions) were given as input to the participating systems, while just one exact answer per question was allowed as output.  ... 
doi:10.1007/978-3-540-31842-2_16 fatcat:4ad3pwr6pnhr5n6v3gwzsqd4cu

The Future of Large-Scale Evaluation Campaigns for Information Retrieval in Europe [chapter]

Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro, Donna Harman, Carol Peters
2007 Lecture Notes in Computer Science  
This poster summarises the outcome of the discussion with respect to the major European activity in this area: the Cross Language Evaluation Forum.  ...  A Workshop on "The Future of Large-scale Evaluation Campaigns" was organised jointly by the University of Padua and the DELOS Network of Excellence and held in Padua, Italy, March 2007.  ...  In the end, the question was whether the best multilingual question answering system was the fastest system or the most accurate one and, given the choice, would the user prefer a faster system over a  ... 
doi:10.1007/978-3-540-74851-9_54 fatcat:hbc2jlp3sfg2jc2fgsspm5u4fe

CLEF: Ongoing Activities and Plans for the Future

Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro, Carol Peters
2007 NTCIR Conference on Evaluation of Information Access Technologies  
For this reason, DELOS has continued to support the activities of the Cross-Language Evaluation Forum (CLEF), which has the promotion of research in multilingual information retrieval system development  ...  Multilingual information access and crosslanguage search and retrieval are key issues for digital libraries.  ...  Multilingual Question Answering Question answering systems have been evaluated for many years at TREC and the track evolved over the years to offer increasingly difficult tasks.  ... 
dblp:conf/ntcir/AgostiNFP07 fatcat:rdf2rg7r2ra5xec24qd6yv66j4

CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum

Nicola Ferro
2010 NTCIR Conference on Evaluation of Information Access Technologies  
After ten years of increasingly successful evaluation campaigns, the Cross-Language Evaluation Forum (CLEF) has come to an appropriate moment to assess what has been achieved in this decade and also to  ...  the first time in CLEF 2010, and it will discuss some future perspective for CLEF, beyond 2010.  ...  Multilingual Question Answering (QA@CLEF). This track has offered monolingual and cross-language question answering tasks since 2003.  ... 
dblp:conf/ntcir/Ferro10 fatcat:xn5ttzldifbevbvvr3jszzelhi

Introduction to the CLEF2013 Labs and Workshop

Roberto Navigli, Dan Tufis
2013 Conference and Labs of the Evaluation Forum  
The CLEF 2013 conference is a new edition of the popular CLEF campaign and workshop series which has run since 2000 contributing to the systematic evaluation of information access systems, primarily through  ...  Labs for CLEF 2013, as in the editions from 2010, 2011 and 2012, are of two types: laboratories to conduct evaluation of information access systems, and workshops to discuss and pilot innovative evaluation  ...  Acknowledgements We would like to thank previous co-chairs of CLEF-LOC 2012 (the CLEF Lab Organisation Committee) for sharing their experience and ensuring thoughtful and elaborate contributions to assessing  ... 
dblp:conf/clef/NavigliT13 fatcat:kg76ulv4inf2jhfzxbqfsqywzm

What Happened in CLEF2009: Introduction to the Working Notes

Carol Peters
2009 Conference and Labs of the Evaluation Forum  
The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development.  ...  These Working Notes contain descriptions of the experiments conducted within CLEF 2009 -the tenth in a series of annual system evaluation campaigns.  ...  Multilingual Question Answering (QA@CLEF): This track has offered monolingual and cross-language question answering tasks since 2003.  ... 
dblp:conf/clef/Peters09b fatcat:p5tpt2abovetffp3tjip2n3n6a

What happened in CLEF 2008: Introduction to the Working Notes

Carol Peters
2008 Conference and Labs of the Evaluation Forum  
The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development.  ...  These Working Notes contain descriptions of the experiments conducted within CLEF 2008 -the ninth in a series of annual system evaluation campaigns.  ...  Acknowledgements CLEF Steering Committee  ... 
dblp:conf/clef/Peters08a fatcat:sguzidsq25hincctifanop2sz4

What happened in CLEF 2007: Introduction to the Working Notes

Carol Peters
2007 Conference and Labs of the Evaluation Forum  
The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development.  ...  These Working Notes contain descriptions of the experiments conducted within CLEF 2007 -the eighth in a series of annual system evaluation campaigns.  ...  Multilingual Question Answering (QA@CLEF): QA@CLEF 2007 proposed both main and pilot tasks.  ... 
dblp:conf/clef/Peters07a fatcat:ppojwxr4dzga3m7anoqmavsmuu

BRUJA System. The University of Jaén at the Spanish Task of CLEFQA 2006

Miguel Ángel García Cumbreras, Luis Alfonso Ureña López, Fernando Javier Martínez Santiago, José Manuel Perea Ortega
2006 Conference and Labs of the Evaluation Forum  
The Multilingual BRUJA system is presented, a Question Answering (QA) system that works with questions in several languages and also collections in several languages.  ...  This paper presents our first participation in the bilingual English-Spanish track at CLEF QA 2006.  ...  The Cross-Language Evaluation Forum (CLEF) includes a multilingual forum to evaluate Question Answering Systems that works with several languages [3] .  ... 
dblp:conf/clef/CumbrerasLSO06 fatcat:w323jd7uhrcjbafunnyom6lbra

What Happened in CLEF 2006: Introduction to the Working Notes

Carol Peters
2006 Conference and Labs of the Evaluation Forum  
The objective of CLEF is to promote research in the field of multilingual system development.  ...  These Working Notes contain descriptions of the experiments conducted within CLEF 2006 -the sixth in a series of annual system evaluation campaigns 1 .  ...  Multilingual Question Answering (QA@CLEF): This track, which has received increasing interest at CLEF since 2003, evaluated both monolingual (non-English) and cross-language QA systems.  ... 
dblp:conf/clef/Peters06a fatcat:x2we7dsuurdezntkuqqpjbstqe

CLEF 2010 conference on multilingual and multimodal information access evaluation

Maristella Agosti, Martin Braschler, Khalid Choukri, Nicola Ferro, Donna Harman, Carol Peters, Emanuele Pianta, Maarten de Rijke, Alan Smeaton
2011 SIGIR Forum  
Since 2000, Cross-Language Evaluation Forum (CLEF) has played a leading role in stimulating research into a wide range of key areas in the information retrieval domain, including cross-language question  ...  answering, image and video search, and interactive retrieval.  ...  CLEF 2010: The Conference The conference aimed at advancing research into the evaluation of complex multimodal and multilingual information systems.  ... 
doi:10.1145/1924475.1924477 fatcat:qx42pcur3venfa2vpzmef4m5u4

The Multiple Language Question Answering Track at CLEF 2003 [chapter]

Bernardo Magnini, Simone Romagnoli, Alessandro Vallin, Jesús Herrera, Anselmo Peñas, Víctor Peinado, Felisa Verdejo, Maarten de Rijke
2004 Lecture Notes in Computer Science  
This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year.  ...  The track was divided into monolingual and bilingual tasks: monolingual systems were evaluated within the frame of three non-English European languages, Dutch, Italian and Spanish, while in the crosslanguage  ...  Stephan Busemann at DFKI and Jian-Yun Nie at the University of Montreal took on the job of translating into German and French the questions for the bilingual tasks, and their contribution was fundamental  ... 
doi:10.1007/978-3-540-30222-3_46 fatcat:kdstrb2wevh5zoucn7iumibze4

The DIOGENE Question Answering System at CLEF-2004 [chapter]

Hristo Tanev, Matteo Negri, Bernardo Magnini, Milen Kouylekov
2005 Lecture Notes in Computer Science  
In contrast, the CLEF conferences provide a multilingual forum for evaluation of NLP systems in languages other than English.  ...  This paper presents the ITC-irst Multilingual Question Answering system DIOGENE. The system was used successfully on the CLEF-2003, TREC-2003, TREC-2002 and TREC-2001.  ...  Conclusion and Future Work We described the architecture of our multilingual system DIOGENE, stressing on the improvements for CLEF-2004.  ... 
doi:10.1007/11519645_43 fatcat:gdr76ig6d5fizagc5flfilhjcu
« Previous Showing results 1 — 15 out of 827 results