Filters








63 Hits in 3.6 sec

Overview of the NTCIR-12 QA Lab-2 Task

Hideyuki Shibuki, Kotaro Sakamoto, Madoka Ishioroshi, Akira Fujita, Yoshinobu Kano, Teruko Mitamura, Tatsunori Mori, Noriko Kando
2016 NTCIR Conference on Evaluation of Information Access Technologies  
The NTCIR-12 QA Lab-2 task aims at the real-world complex Question Answering (QA) technologies using Japanese university entrance exams and their English translation on the subject of "World history".  ...  We conducted three phases of formal runs, and collaborated on Phase-2 Japanese subtask with the Todai Robot Project. Twelve teams submitted 148 runs in total.  ...  ., Sundai Preparatory School, Benesse Corporation, Yoyogi Seminar and the answer creaters. Part of the task organization was supported by NII's Todai Robot Project [3]  ... 
dblp:conf/ntcir/ShibukiSIFKMMK16 fatcat:yjcpxtlknvafvfuayo2jd7lvq4

Overview of the NTCIR-13 QA Lab-3 Task

Hideyuki Shibuki, Kotaro Sakamoto, Madoka Ishioroshi, Yoshinobu Kano, Teruko Mitamura, Tatsunori Mori, Noriko Kando
2017 NTCIR Conference on Evaluation of Information Access Technologies  
The NTCIR-13 QA Lab-3 task aims at the real-world complex Question Answering (QA) technologies using Japanese university entrance exams and their English translation on the subject of "World history".  ...  QA Lab-3 has three end-toend tasks for multiple-choice, term and essay questions. The essay task has three subtasks of extraction, summarization and evaluation-method.  ...  Part of the task organization was supported by NII's Todai Robot Project [4]  ... 
dblp:conf/ntcir/ShibukiSIKMMK17 fatcat:su6cvqoex5foxeqpneijhfrviy

Overview of the Fifth NTCIR Workshop

Noriko Kando
2005 NTCIR Conference on Evaluation of Information Access Technologies  
This paper outlines the fifth NTCIR Workshop, which is the latest in a series. It briefly describes the background, tasks, participants, and test collections of the workshop.  ...  The purpose of this paper is to serve as an introduction to the research described in detail in the rest of the proceedings of the fifth NTCIR Workshop.  ...  Focus of NTCIR Workshops Table 2 . 2 Active Participating Groups of the Third NTCIR Workshop National Institute of Information and Communications Technology NTT CS Lab.  ... 
dblp:conf/ntcir/Kando05a fatcat:j2gcrvtrdrfizdokiobwfep2te

Finding Old Answers to New Math Questions: The ARQMath Lab at CLEF 2020 [chapter]

Behrooz Mansouri, Anurag Agarwal, Douglas Oard, Richard Zanibbi
2020 Lecture Notes in Computer Science  
The ARQMath Lab at CLEF 2020 considers the problem of finding answers to new mathematical questions among posted answers on a community question answering site (Math Stack Exchange).  ...  based on the original question.  ...  Access Research (at NTCIR-10 [1], NTCIR-11 [2] and NTCIR-12 [12] ).  ... 
doi:10.1007/978-3-030-45442-5_73 fatcat:vvs3dfiyibd2bi4okcv7z6muy4

Overview of the NTCIR-11 QA-Lab Task

Hideyuki Shibuki, Kotaro Sakamoto, Yoshinobu Kano, Teruko Mitamura, Madoka Ishioroshi, Kelly Y. Itakura, Di Wang, Tatsunori Mori, Noriko Kando
2014 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes an overview of the first QA Lab (Question Answering Lab for Entrance Exam) task at NTCIR 11.  ...  The goal of the QA lab is to provide a module-based platform for advanced question answering systems and comparative evaluation for solving real-world university entrance exam questions.  ...  CONCLUSION This paper introduced the overview of the first QA Lab (Question Answering Lab for Entrance Exam) task at NTCIR 11.  ... 
dblp:conf/ntcir/ShibukiSKMIIWMK14 fatcat:swb3rqz3njgjlkjjsofwgj22iq

NTCIR-6 Preface

Noriko Kando
2007 NTCIR Conference on Evaluation of Information Access Technologies  
This paper outlines the sixth NTCIR Workshop, which is the latest in a series. It briefly describes the background, tasks, participants, and test collections of the workshop.  ...  The purpose of this paper is to serve as an introduction to the research described in detail in the rest of the proceedings of the sixth NTCIR Workshop.  ...  Discussion A brief overview of the Sixth NTCIR Workshop is reported here.  ... 
dblp:conf/ntcir/Kando07 fatcat:kjl4irhfizcu7gxvpp3gxebmje

Multi-choice Question Answering System of WIP at the NTIR-12 QA Lab-2

Bingfeng Luo, Yuxuan Lai, Lili Yao, Yansong Feng, Dongyan Zhao
2016 NTCIR Conference on Evaluation of Information Access Technologies  
In the final evaluation, we achieved 34 points on the 2011 test dataset.  ...  This paper describes a multi-choice question answering system we designed for the .  ...  CONCLUSION We described our system at the NTCIR-12 QA-Lab Task in this paper.  ... 
dblp:conf/ntcir/LuoLYFZ16 fatcat:43wvfpdyzbht5gmq37agw5imuu

Overview of QA4MRE 2013 Entrance Exams Task

Anselmo Peñas, Yusuke Miyao, Eduard H. Hovy, Pamela Forner, Noriko Kando
2013 Conference and Labs of the Evaluation Forum  
The data set of this task is extracted from actual university entrance examinations as-is, and therefore includes a variety of topics in daily life.  ...  Another unique feature of the Entrance Exams task is that questions are designed originally for testing human examinees, rather than evaluating computer systems.  ...  ACKNOWLEDGEMENTS The collaboration has been developed in the framework of Todai Robot Project in Japan, and the CHIST-ERA Readers project in Europe.  ... 
dblp:conf/clef/PenasMHFK13 fatcat:v2sqkr4a4zclzk75z6ppsui3wy

The Question Answering System of DCUMT in NTCIR-11 QALab

Tsuyoshi Okita, Qun Liu
2014 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in .  ...  exam task in Phase 2 in terms of precision were 71.4 (UTokyo), 62.5 (KyotoU), 71.8 (Hokkaido), 62.7 (Waseda), and 80.0 (Chuo) which were the first among two submissions.  ...  This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in NTCIR-11.  ... 
dblp:conf/ntcir/OkitaL14 fatcat:qgjtd5skand47isry4xndsbqn4

NUL System at QALab Tasks

Hiroshi Miyashita, Ai Ishii, Mio Kobayashi, Chikara Hoshino
2014 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes the submitted strategy and the methods of NUL team on NTCIR-11 QALab Center examination tasks.  ...  Our purpose of joining this task is to evaluate the entailment recognition systems which we made for RITE-VAL tasks.  ...  the 11th NTCIR Conference, December 9-12, 2014, Tokyo, Japan  ... 
dblp:conf/ntcir/MiyashitaIKH14 fatcat:yv5hkyscnjb67hfm7jnoapfd5q

Overview of CLEF QA Entrance Exams Task 2014

Anselmo Peñas, Yusuke Miyao, Álvaro Rodrigo, Eduard H. Hovy, Noriko Kando
2014 Conference and Labs of the Evaluation Forum  
This paper describes the Entrance Exams task at the CLEF QA Track 2014.  ...  Systems receive a set of Multiple-Choice Reading Comprehension tests where the task is to select the correct answer among a finite set of candidates, according to the given text.  ...  ACKNOWLEDGEMENTS The collaboration has been developed in the framework of Todai Robot Project in Japan, and the CHIST-ERA Readers project in Europe (MINECO PCIN-2013-002-C02-01).  ... 
dblp:conf/clef/PenasMRHK14 fatcat:2yq6hgtjeva33paui2lrhnhoxi

Overview of the NTCIR-7 ACLIA Tasks: Advanced Cross-Lingual Information Access

Teruko Mitamura, Eric Nyberg, Hideki Shima, Tsuneaki Kato, Tatsunori Mori, Chin-Yew Lin, Ruihua Song, Chuan-Jie Lin, Tetsuya Sakai, Donghong Ji, Noriko Kando
2008 NTCIR Conference on Evaluation of Information Access Technologies  
This paper presents an overview of the ACLIA (Advanced Cross-Lingual Information Access) task cluster.  ...  The task overview includes: a definition of and motivation for the evaluation; a description of the complex question types evaluated; the document sources and exchange formats selected and/or defined;  ...  We also greatly appreciate the efforts of all the ACLIA participants.  ... 
dblp:conf/ntcir/MitamuraNSKMLSL08 fatcat:qi5n45pcmrfg3keysczotthaeq

The Scholarly Impact of CLEF (2000–2009) [chapter]

Theodora Tsikrika, Birger Larsen, Henning Müller, Stefan Endrullis, Erhard Rahm
2013 Lecture Notes in Computer Science  
Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest.  ...  Moreover, initial analysis indicates that the scholarly impact of ImageCLEF is comparable to that of TRECVid. 1 Text REtrieval Conference (http://trec.nist.gov/) 2 Cross-Language Evaluation Forum (http  ...  This work was partially supported by the ELIAS ESF Research Networking Programme, and by the Promise (258191) and Khresmoi (257528) FP7 projects.  ... 
doi:10.1007/978-3-642-40802-1_1 fatcat:533ffulnnbcedphg33kgobcney

CLIR System Evaluation at the Second NTCIR Workshop [chapter]

Noriko Kando
2002 Lecture Notes in Computer Science  
A brief history, tasks, participants, test collections, CLIR evaluation at the workshops, and plan for the next workshop are described in this paper.  ...  This paper introduces , a series of evaluation workshops, which is designed to enhance research in information retrieval and related text processing techniques, such as summarization, extraction, by providing  ...  (Japan) As shown in the shows the distribution of the attribute of each participating group across the tasks. ATT Labs & Duke Univ.  ... 
doi:10.1007/3-540-45691-0_35 fatcat:e7hs7aldgncv3mqr74j3zolbqy

CLEF 2014

Linda Cappellato, Mark Sanderson, Elaine Toms, Robert Villa, Paul Clough, Nicola Ferro, Mark Hall, Martin Halvey, Allan Hanbury, Evangelos Kanoulas, Wessel Kraaij, Mihai Lupu
2014 SIGIR Forum  
Acknowledgments The success of CLEF 2014 would not have been possible without the contributions of the members of the Programme Committee, the Organizing Committee, Lab Organizers, students volunteers  ...  We would also like to acknowledge the support provided by Microsoft Research and the University of Sheffield.  ...  Details about the activities and the outcomes of each lab are reported in the lab proceedings and here we provide just a brief overview of them.  ... 
doi:10.1145/2701583.2701589 fatcat:oellkoy6zfehfg7hgyaumipvzy
« Previous Showing results 1 — 15 out of 63 results