A Deep Neural Network Sentence Level Classification Method with Context Information

Xingyi Song, Johann Petrak, Angus Roberts
2018 Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing  
Reuse This article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: https://creativecommons.org/licenses/ Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing eprints@whiterose.ac.uk
more » ... ding the URL of the record and the reason for the withdrawal request. Abstract In the sentence classification task, context formed from sentences adjacent to the sentence being classified can provide important information for classification. This context is, however, often ignored. Where methods do make use of context, only small amounts are considered, making it difficult to scale. We present a new method for sentence classification, Context-LSTM-CNN, that makes use of potentially large contexts. The method also utilizes long-range dependencies within the sentence being classified, using an LSTM, and short-span features, using a stacked CNN. Our experiments demonstrate that this approach consistently improves over previous methods on two different datasets.
doi:10.18653/v1/d18-1107 dblp:conf/emnlp/SongPR18 fatcat:7gdy2p3jxnctbpsirixh6z2bcu