Overview of the SPMRL 2013 Shared Task: A Cross-Framework Evaluation of Parsing Morphologically Rich Languages

Djamé Seddah, Reut Tsarfaty, Sandra Kübler, Marie Candito, Jinho D. Choi, Richárd Farkas, Jennifer Foster, Iakes Goenaga, Koldo Gojenola Galletebeitia, Yoav Goldberg, Spence Green, Nizar Habash (+11 others)
2013 Workshop on Statistical Parsing of Morphologically Rich Languages  
This paper reports on the first shared task on statistical parsing of morphologically rich languages (MRLs). The task features data sets from nine languages, each available both in constituency and dependency annotation. We report on the preparation of the data sets, on the proposed parsing scenarios, and on the evaluation metrics for parsing MRLs given different representation types. We present and analyze parsing results obtained by the task participants, and then provide an analysis and
more » ... rison of the parsers across languages and frameworks, reported for gold input as well as more realistic parsing scenarios.
dblp:conf/acl-spmrl/SeddahTKCCFFGGG13 fatcat:5ngltl7jr5hu5o72goudyy4tuq