Performance issues and error analysis in an open-domain Question Answering system

Dan Moldovan, Marius Paşca, Sanda Harabagiu, Mihai Surdeanu
2001 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02  
This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.
doi:10.3115/1073083.1073091 dblp:conf/acl/MoldovanPHS02 fatcat:yykmw4tjsjbohkocbyzewsrboa