LSDSem 2017 Shared Task: The Story Cloze Test

Nasrin Mostafazadeh, Michael Roth, Annie Louis, Nathanael Chambers, James Allen
2017 Proceedings of the 2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics  
The LSDSem'17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choose the correct ending to the story. Successful narrative understanding (getting closer to human performance of 100%) requires systems to link various levels of semantics to commonsense knowledge. A total of eight systems participated in the shared task, with a variety of
more » ... including end-to-end neural networks, feature-based regression models, and rule-based methods. The highest performing system achieves an accuracy of 75.2%, a substantial improvement over the previous state-of-the-art.
doi:10.18653/v1/w17-0906 dblp:conf/eacl/MostafazadehRLC17 fatcat:nwetyrkdlbaxfcm6raycx3vjla