Filters








53 Hits in 4.7 sec

Overview of the NTCIR-13 QA Lab-3 Task

Hideyuki Shibuki, Kotaro Sakamoto, Madoka Ishioroshi, Yoshinobu Kano, Teruko Mitamura, Tatsunori Mori, Noriko Kando
2017 NTCIR Conference on Evaluation of Information Access Technologies  
The NTCIR-13 QA Lab-3 task aims at the real-world complex Question Answering (QA) technologies using Japanese university entrance exams and their English translation on the subject of "World history".  ...  QA Lab-3 has three end-toend tasks for multiple-choice, term and essay questions. The essay task has three subtasks of extraction, summarization and evaluation-method.  ...  Part of the task organization was supported by NII's Todai Robot Project [4]  ... 
dblp:conf/ntcir/ShibukiSIKMMK17 fatcat:su6cvqoex5foxeqpneijhfrviy

SLQAL at the NTCIR-13 QA Lab-3 Task

Kou Sato, Tetsuya Sakai
2017 NTCIR Conference on Evaluation of Information Access Technologies  
The SLQAL team participated in Phase-1, Phase-2 and Research run of the NTCIR-13 QA Lab-3 Japanese subtask(National Center Tests(Multiple-Choice type questions)) [2] .  ...  INTRODUCTION The SLQAL team participated in Phase-1, Phase-2 and Research run of the NTCIR-13 QA Lab-3 Japanese subtask (National Center Tests (Multiple-Choice type questions)) [2] .  ...  CONCLUSIONS AND FUTURE WORK The SLQAL team participated in Phase-1, Phase-2 and Research Run of the NTCIR-13 QA Lab-3 Japanese subtask (National Center Tests Multiple-Choice type questions).  ... 
dblp:conf/ntcir/SatoS17 fatcat:keubumh36bar5ocbth54cm66mu

Overview of the NTCIR-12 QA Lab-2 Task

Hideyuki Shibuki, Kotaro Sakamoto, Madoka Ishioroshi, Akira Fujita, Yoshinobu Kano, Teruko Mitamura, Tatsunori Mori, Noriko Kando
2016 NTCIR Conference on Evaluation of Information Access Technologies  
The NTCIR-12 QA Lab-2 task aims at the real-world complex Question Answering (QA) technologies using Japanese university entrance exams and their English translation on the subject of "World history".  ...  We describe the used data, the hierarchy of question formats, formal run results, and comparison between human marks and automatic evaluation scores for essay questions.  ...  ., Sundai Preparatory School, Benesse Corporation, Yoyogi Seminar and the answer creaters. Part of the task organization was supported by NII's Todai Robot Project [3]  ... 
dblp:conf/ntcir/ShibukiSIFKMMK16 fatcat:yjcpxtlknvafvfuayo2jd7lvq4

Overview of the Fifth NTCIR Workshop

Noriko Kando
2005 NTCIR Conference on Evaluation of Information Access Technologies  
This paper outlines the fifth NTCIR Workshop, which is the latest in a series. It briefly describes the background, tasks, participants, and test collections of the workshop.  ...  The purpose of this paper is to serve as an introduction to the research described in detail in the rest of the proceedings of the fifth NTCIR Workshop.  ...  Discussion A brief overview of the fifth NTCIR Workshop is reported here.  ... 
dblp:conf/ntcir/Kando05a fatcat:j2gcrvtrdrfizdokiobwfep2te

Overview of the NTCIR-11 QA-Lab Task

Hideyuki Shibuki, Kotaro Sakamoto, Yoshinobu Kano, Teruko Mitamura, Madoka Ishioroshi, Kelly Y. Itakura, Di Wang, Tatsunori Mori, Noriko Kando
2014 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes an overview of the first QA Lab (Question Answering Lab for Entrance Exam) task at NTCIR 11.  ...  The goal of the QA lab is to provide a module-based platform for advanced question answering systems and comparative evaluation for solving real-world university entrance exam questions.  ...  CONCLUSION This paper introduced the overview of the first QA Lab (Question Answering Lab for Entrance Exam) task at NTCIR 11.  ... 
dblp:conf/ntcir/ShibukiSKMIIWMK14 fatcat:swb3rqz3njgjlkjjsofwgj22iq

NTCIR-6 Preface

Noriko Kando
2007 NTCIR Conference on Evaluation of Information Access Technologies  
This paper outlines the sixth NTCIR Workshop, which is the latest in a series. It briefly describes the background, tasks, participants, and test collections of the workshop.  ...  The purpose of this paper is to serve as an introduction to the research described in detail in the rest of the proceedings of the sixth NTCIR Workshop.  ...  Discussion A brief overview of the Sixth NTCIR Workshop is reported here.  ... 
dblp:conf/ntcir/Kando07 fatcat:kjl4irhfizcu7gxvpp3gxebmje

Question Answering Challenge for Five Ranked Answers and List Answers - Overview of NTCIR4 QAC2 Subtask 1 and 2

Jun-ichi Fukumoto, Tsuneaki Kato, Fumito Masui
2004 NTCIR Conference on Evaluation of Information Access Technologies  
In this paper we describe an evaluation of question answering task, Question Answering Challenge 2 (QAC2). This evaluation project was first carried out at the NTCIR Workshop 3 in October 2002.  ...  We defined three kinds of tasks in the QAC2 as well as QAC1: Subtask 1, where questions required five possible answers in some order, Subtask 2, where questions had one list of answers and Subtask 3, where  ...  Acknowledgements We would like to express our thanks to all of the task participants and members of the organizing committee.  ... 
dblp:conf/ntcir/FukumotoKM04 fatcat:fuv7fbodvjbufihkzpq4n4bbby

Overview of QA4MRE 2013 Entrance Exams Task

Anselmo Peñas, Yusuke Miyao, Eduard H. Hovy, Pamela Forner, Noriko Kando
2013 Conference and Labs of the Evaluation Forum  
The data set of this task is extracted from actual university entrance examinations as-is, and therefore includes a variety of topics in daily life.  ...  Another unique feature of the Entrance Exams task is that questions are designed originally for testing human examinees, rather than evaluating computer systems.  ...  ACKNOWLEDGEMENTS The collaboration has been developed in the framework of Todai Robot Project in Japan, and the CHIST-ERA Readers project in Europe.  ... 
dblp:conf/clef/PenasMHFK13 fatcat:v2sqkr4a4zclzk75z6ppsui3wy

The Question Answering System of DCUMT in NTCIR-11 QALab

Tsuyoshi Okita, Qun Liu
2014 NTCIR Conference on Evaluation of Information Access Technologies  
This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in .  ...  exam task in Phase 2 in terms of precision were 71.4 (UTokyo), 62.5 (KyotoU), 71.8 (Hokkaido), 62.7 (Waseda), and 80.0 (Chuo) which were the first among two submissions.  ...  This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in NTCIR-11.  ... 
dblp:conf/ntcir/OkitaL14 fatcat:qgjtd5skand47isry4xndsbqn4

Overview of the NTCIR-7 ACLIA Tasks: Advanced Cross-Lingual Information Access

Teruko Mitamura, Eric Nyberg, Hideki Shima, Tsuneaki Kato, Tatsunori Mori, Chin-Yew Lin, Ruihua Song, Chuan-Jie Lin, Tetsuya Sakai, Donghong Ji, Noriko Kando
2008 NTCIR Conference on Evaluation of Information Access Technologies  
This paper presents an overview of the ACLIA (Advanced Cross-Lingual Information Access) task cluster.  ...  The task overview includes: a definition of and motivation for the evaluation; a description of the complex question types evaluated; the document sources and exchange formats selected and/or defined;  ...  We also greatly appreciate the efforts of all the ACLIA participants.  ... 
dblp:conf/ntcir/MitamuraNSKMLSL08 fatcat:qi5n45pcmrfg3keysczotthaeq

The Scholarly Impact of CLEF (2000–2009) [chapter]

Theodora Tsikrika, Birger Larsen, Henning Müller, Stefan Endrullis, Erhard Rahm
2013 Lecture Notes in Computer Science  
Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest.  ...  ://www.clef-initiative.eu/) 3 INitiative for the Evaluation of XML retrieval (http://www.inex.otago.ac.nz/) 4 NTCIR Evaluation of Information Access Technologies (http://ntcir.nii.ac.jp/) 5 Forum for Information  ...  This work was partially supported by the ELIAS ESF Research Networking Programme, and by the Promise (258191) and Khresmoi (257528) FP7 projects.  ... 
doi:10.1007/978-3-642-40802-1_1 fatcat:533ffulnnbcedphg33kgobcney

CLIR System Evaluation at the Second NTCIR Workshop [chapter]

Noriko Kando
2002 Lecture Notes in Computer Science  
A brief history, tasks, participants, test collections, CLIR evaluation at the workshops, and plan for the next workshop are described in this paper.  ...  This paper introduces , a series of evaluation workshops, which is designed to enhance research in information retrieval and related text processing techniques, such as summarization, extraction, by providing  ...  The CLIR task at the NTCIR Workshop 3 will be organized by the organizers of CHTR and JEIR, and HANTEC group.  ... 
doi:10.1007/3-540-45691-0_35 fatcat:e7hs7aldgncv3mqr74j3zolbqy

Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15 [article]

Daiki Shirafuji, Hiromichi Kameya, Rafal Rzepka, Kenji Araki
2020 arXiv   pre-print
Summarization subtask in QA Lab-PoliInfo-2 task of the NTCIR-15 addresses this problem for Japanese utterances in assembly minutes, and our team (SKRA) participated in this subtask.  ...  This paper describes our approach to solving the task and discusses its results.  ...  Our model specializes in political sentences, which are the core of the QA Lab-PoliInfo-2 tasks at NTCIR-15 evaluation conference.  ... 
arXiv:2010.12077v1 fatcat:wxjkj5xj4ndhpojdkdqhoju4ru

Cross-language Information Retrieval [article]

Petra Galuščáková, Douglas W. Oard, Suraj Nair
2022 arXiv   pre-print
This chapter reviews the state of the art for CLIR and outlines some open research questions.  ...  Two key assumptions shape the usual view of ranked retrieval: (1) that the searcher can choose words for their query that might appear in the documents that they wish to see, and (2) that ranking retrieved  ...  Overview of the NTCIR-7 ACLIA IR4QA task. In NTCIR, 01 0001. [167] T. Sakai, D. W. Oard, and N. Kando.  ... 
arXiv:2111.05988v2 fatcat:4f3qbtcswvdavhzhufehdlbyry

A Cascade Model for Argument Mining in Japanese Political Discussions: the QA Lab-PoliInfo-3 Case Study [article]

Ramon Ruiz-Dolz
2022 arXiv   pre-print
The rVRAIN team tackled the Budget Argument Mining (BAM) task, consisting of a combination of classification and information retrieval sub-tasks.  ...  For the information retrieval (i.e., relation ID detection or RID), our best results were achieved by a combination of a BERT-based binary classifier, and the cosine similarity of pairs consisting of the  ...  ACKNOWLEDGMENTS This work is supported by the Spanish Government project PID2020-113416RB-I00.  ... 
arXiv:2207.01672v1 fatcat:bexu7djwd5hxtgxtaccunphvua
« Previous Showing results 1 — 15 out of 53 results