SemEval-2014 Task 3: Cross-Level Semantic Similarity

David Jurgens, Mohammad Taher Pilehvar, Roberto Navigli
2014 Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014)  
This paper introduces a new SemEval task on Cross-Level Semantic Similarity (CLSS), which measures the degree to which the meaning of a larger linguistic item, such as a paragraph, is captured by a smaller item, such as a sentence. Highquality data sets were constructed for four comparison types using multi-stage annotation procedures with a graded scale of similarity. Nineteen teams submitted 38 systems. Most systems surpassed the baseline performance, with several attaining high performance
more » ... r multiple comparison types. Further, our results show that comparisons of semantic representation increase performance beyond what is possible with text alone. This work is licensed under a Creative Commons Attribution 4.0 International License. Page numbers and proceedings footer are added by the organizers. License details: http: //
doi:10.3115/v1/s14-2003 dblp:conf/semeval/JurgensPN14 fatcat:6c5rt6hwyjfzzktnmo5vqaarpe