A Comparative Evaluation of QA Systems over List Questions [chapter]

Patricia Nunes Gonçalves, António Horta Branco
2016 Lecture Notes in Computer Science  
The evaluation of a Question Answering system is a challenging task. In this paper we evaluate our system, LX-ListQuestion, a Web-based QA System that focuses on answering list questions. We compare our system against other QA Systems and the results were analyzed in two ways: (i) the quantitative evaluation of answers provides recall, precision and F-measure and (ii) the question coverage that indicate the usefulness of the system to the user by counting the number of questions for which the
more » ... stem provides at least one correct answer. The evaluation brings interesting results that points to a certain degree of complementary between different approaches.
doi:10.1007/978-3-319-41552-9_11 fatcat:qfb3tmcrlzfjxhahnitko6hwdq