Filters








17 Hits in 3.5 sec

Overview of QA4MRE Main Task at CLEF 2013

Richard F. E. Sutcliffe, Anselmo Peñas, Eduard H. Hovy, Pamela Forner, Álvaro Rodrigo, Corina Forascu, Yassine Benajiba, Petya Osenova
2013 Conference and Labs of the Evaluation Forum  
This paper describes the Question Answering for Machine Reading (QA4MRE) Main Task at the 2013 Cross Language Evaluation Forum.  ...  We introduced two novelties this year: auxiliary questions to evaluate systems level of inference, and a portion of questions where none of the options were correct.  ...  Special thanks are due to Giovanni Moretti (CELCT, Trento, Italy) for the technical support in the management of all data and evaluation scripts of the campaign.  ... 
dblp:conf/clef/SutcliffePHFRFBO13 fatcat:zvi5rbg6g5bstilqdiujvqefyi

QA4MRE 2011-2013: Overview of Question Answering for Machine Reading Evaluation [chapter]

Anselmo Peñas, Eduard Hovy, Pamela Forner, Álvaro Rodrigo, Richard Sutcliffe, Roser Morante
2013 Lecture Notes in Computer Science  
This was the attempt of the QA4MRE challenge which was run as a Lab at CLEF 2011-2013.  ...  This paper describes the methodology for testing the performance of Machine Reading systems through Question Answering and Reading Comprehension Tests.  ...  Eduard Hovy was supported by two DARPA grants in Machine Reading.  ... 
doi:10.1007/978-3-642-40802-1_29 fatcat:5p2elqqoxzawfk3s54qzdiwsmq

Question Answering for Machine Reading with Lexical Chain

Ling Cao, Xipeng Qiu, Xuanjing Huang
2011 Conference and Labs of the Evaluation Forum  
Question answering for machine reading (QA4MR) is a task to understand the meaning communicated by a text. In this paper, we present our system in QA4MRE 1 .  ...  On the QA4MRE test dataset, our system achieves the c@1 measure of 0.28 and 0.26 for the two submissions, respectively.  ...  Question answering for machine reading (QA4MR) [12] is a task to answer questions by reading of single documents.  ... 
dblp:conf/clef/CaoQH11 fatcat:bropypqqfrc3jcozym74vvvnlq

CLEF 2011

Paul Clough, Nicola Ferro, Pamela Forner, Julio Gonzalo, Bouke Huurnink, Jaana Kekäälåinen, Mounia Lalmas, Vivien Petras, Maarten de Rijke
2012 SIGIR Forum  
CLEF 2011 was sponsored by: the Center for Creation, Content and Technology (CCCT), the City of Amsterdam, the ELIAS Research Network Programme, Microsoft Research, the Netherlands Institute for Sound  ...  CLEF relies on an incredible amount of voluntary work and enthusiasm: we would like to thank all those people whose contributions have allowed CLEF to grow and improve year after year.  ...  QA4MRE -Question Answering for Machine Reading Evaluation: This was a new task proposed by organizers of the previous Question Answering (QA) track of CLEF.  ... 
doi:10.1145/2093346.2093349 fatcat:3g7glfufgrhzdpaxk7ckskqxly

Overview of the QA4MRE Pilot Task: Annotating Modality and Negation for a Machine Reading Evaluation

Roser Morante, Walter Daelemans
2011 Conference and Labs of the Evaluation Forum  
In this paper we describe the task Processing modality and negation for machine reading, which was organized as a pilot task of the Question Answering for Machine Reading Evaluation (QA4MRE) Lab at CLEF  ...  2011.  ...  We are grateful to the organizers of the QA4MRE lab at CLEF 2011 for their support and for hosting the pilot task. Bibliography  ... 
dblp:conf/clef/MoranteD11 fatcat:3rlq3o4hyngu3c3op7fymmrxdu

CLEF 2012

Tiziana Catarci, Nicola Ferro, Pamela Forner, Djoerd Hiemstra, Jussi Karlgren, Anselmo Peñas, Giuseppe Santucci, Christa Womser-Hacker
2012 SIGIR Forum  
Acknowledgments The success of CLEF 2012 would not have been possible without the invaluable contributions of all the members of the Program Committee, Organizing Committee, students and volunteers that  ...  Finally, we would like to express our gratitude to the following sponsoring organizations for their significant and timely support: ELIAS Research Network Programme, Quaero, PROMISE Network of Excellence  ...  QA4MRE Question Answering for Machine Reading evaluates machine reading abilities through question answering and reading comprehension tests and offered three tasks: reading of single documents and identification  ... 
doi:10.1145/2422256.2422261 fatcat:yv3w4ozkg5fsbf5hkd6bayuj64

IDRAAQ: New Arabic Question Answering System Based on Query Expansion and Passage Retrieval

Lahsen Abouenour, Karim Bouzoubaa, Paolo Rosso
2012 Conference and Labs of the Evaluation Forum  
Experiments have been conducted in the framework of the main task of QA4MRE@CLEF 2012 that includes this year the Arabic language. Two runs were submitted.  ...  The same experiments allowed us to identify the lacks of the system especially when processing non factoid questions and at the Answer Validation stage.  ...  Acknowledgment The European Commission as part of the WIQ-EI IRSES-Project (grant no. 269180) within the FP 7 Marie Curie People Framework has partially funded the work of the third author.  ... 
dblp:conf/clef/AbouenourBR12 fatcat:pfmme2eawvdulljjnmkqxazijq

CLEF 2013

Nicola Ferro, Pamela Forner, Henning Müller, Roberto Navigli, Roberto Paredes, Paolo Rosso, Benno Stein, Dan Tufis
2013 SIGIR Forum  
Acknowledgments The success of CLEF 2013 would not have been possible without the contributions of the members of the Program Committee, the Organizing Committee, the students, and other volunteers who  ...  We would like to express our gratitude to the following sponsoring organizations for their support: PROMISE 3 Network of Excellence (contract n. 258191), ELIAS 4 Research Network Programme, European Science  ...  Number of participating teams: 46 QA4MRE -Question Answering for Machine Reading Evaluation Main goal of this lab is to develop a methodology for evaluating machine reading systems through question answering  ... 
doi:10.1145/2568388.2568392 fatcat:ezpo2wtb65cmrpjowvvnk3q374

Inter-Sentence Features and Thresholded Minimum Error Rate Training: NAIST at CLEF 2013 QA4MRE

Philip Arthur, Graham Neubig, Sakriani Sakti, Tomoki Toda, Satoshi Nakamura
2013 Conference and Labs of the Evaluation Forum  
This paper describes the Nara Institute of Science and Technology's system for the main task of CLEF 2013 QA4MRE.  ...  The system received a score of 28% c@1 on main questions and 33% c@1 when considering auxiliary questions on the CLEF 2013 evaluation.  ...  To train the parameters of our model, we use both test set documents from past CLEF 2011 and 2012 QA4MRE campaigns [9] .  ... 
dblp:conf/clef/ArthurNSTN13 fatcat:drtdgq2z6nfvrnyt7nc5sjykt4

Arabic Information Retrieval

Kareem Darwish
2014 Foundations and Trends in Information Retrieval  
Overview of QA4MRE at CLEF 2012: Question answering for machine reading eval- uation. In 2012 Conference and Labs of the Evaluation Forum (CLEF) (Online Working Notes/Labs/Workshop).  ...  Overview of CLEF 2008 INFILE Pilot Track. Evaluating Systems for Multilingual and Multi- modal Information Access, in the 2009 Cross-Language Evaluation Fo- rum (CLEF), pp. 939-946.  ... 
doi:10.1561/1500000031 fatcat:2nxjdu43erhdvbs35ykavrk76a

Assessing Back-Translation as a Corpus Generation Strategy for non-English Tasks: A Study in Reading Comprehension and Word Sense Disambiguation

Fabricio Monsalve, Kervy Rivas Rojas, Marco Antonio Sobrevilla Cabezudo, Arturo Oncevay
2019 Proceedings of the 13th Linguistic Annotation Workshop  
Corpora curated by experts have sustained Natural Language Processing mainly in English, but the expensiveness of corpora creation is a barrier for the development in further languages.  ...  We conclude that it is possible to systematise the building of quality corpora using machine translation and automatic metrics, besides some prior effort to clean and process the data.  ...  Besides, we acknowledge the support of the NVIDIA Corporation with the donation of the Titan Xp GPU used for this study.  ... 
doi:10.18653/v1/w19-4010 dblp:conf/acllaw/MonsalveRCO19 fatcat:5jjgnvdamzdj5arzdet73ghtoi

Text mining for systems biology

Juliane Fluck, Martin Hofmann-Apitius
2014 Drug Discovery Today  
Modelling of complex biological processes, spanning pathways to entire diseases, can be done at various levels of granularity using a range of mathematical modelling approaches [2] .  ...  A recent review on text-mining technologies enabling integrative biology provides a good overview of some of the academic technology developments made in this context [1].  ...  In 2013, the Question Answering for Machine Reading Evaluation (QA4MRE) supported a new task 'Machine reading of biomedical texts about Alzheimer's Disease in CLEF (Conference and Labs of the Evaluation  ... 
doi:10.1016/j.drudis.2013.09.012 pmid:24070668 fatcat:ajnerehdqndv5nk3l6jak42n5e

Task 1 of the CLEF eHealth Evaluation Lab 2014

Hanna Suominen, Tobias Schreck, Gondy Leroy, Harry Hochheiser, Lorraine Goeuriot, Liadh Kelly, Danielle L. Mowery, Jaume Nualart, Gabriela Ferraro, Daniel A. Keim
2014 Conference and Labs of the Evaluation Forum  
Four panellists evaluated the submission. Overall, they were positive about the enhancements, but all agreed that additional visualization could further improve the provided solution.  ...  Discharge summaries serve a variety of aims, ranging from clinical care to legal purposes.  ...  We greatly appreciate the hard work and feedback of our evaluation panelists Hilary Cinis, Senior User Experience Designer, NICTA, Sydney, NSW, Australia; Chih-Hao (Justin) Ku, Assistant Professor in Text  ... 
dblp:conf/clef/SuominenSLHGKMNFK14 fatcat:vqzpav6kzvdoxd7abbkzvg26qy

READING COMPREHENSION SYSTEM-A REVIEW

K Arivuchelvan, And Lakahmi
2017 Indian J.Sci.Res   unpublished
Reading Comprehension can be viewed as single document question answering system. Machine reading comprehension becomes more vital to get the required information in no time.  ...  Many researchers are working in the area of machine reading comprehension since 1990s. Maturity of Natural Language Processing and AI has lead to the research in machine reading comprehension.  ...  Suzan Verberne (2011) had proposed retrieval based question answering system for machine reading evaluation.  ... 
fatcat:5d2cci72yzfbbemip5ed5t7dgq

A Review of Question Answering Systems

Bolanle Ojokoh, Emmanuel Adebisi
2019 Journal of Web Engineering  
These issues include Question Processing, Question Classes, Data Sources for QA, Context and QA, Answer Extraction, Real time Question Answering, Answer Formulation, Multilingual (or cross-lingual) question  ...  A lot of QA surveys have classified QuestionAnswering systems based on different criteria such as queries inquired by users, features of data bases used, nature of generated answers, question answering  ...  A Hybrid Question Answering System for Multiple Choice Question (MCQ). QA4MRE@CLEF 2013. is a Ph.D. student at the Federal University of Technology, Akure since March 2019.  ... 
doi:10.13052/jwe1540-9589.1785 fatcat:g4bbctufvjd6fkijclxd5rnth4
« Previous Showing results 1 — 15 out of 17 results