CKY Parsing with Independence Constraints

Joseph Irwin, Yuji Matsumoto
2015 Proceedings of the 14th International Conference on Parsing Technologies  
The CKY algorithm is an important component in many natural language parsers. We propose a novel type of constraint for context-free parsing called independence constraints. Based on the concept of independence between words, we show how these constraints can be used to reduce the work done in the CKY algorithm. We demonstrate a classifier which can be used to identify boundaries between independent words in a sentence using only surface features, and show that it can be used to speed up a CKY
more » ... arser. We investigate the trade-off between speed and accuracy, and indicate directions for improvement.
doi:10.18653/v1/w15-2213 dblp:conf/iwpt/IrwinM15 fatcat:qmkjeimtlvhrreefeqrzfppbxy