Ternary Segmentation for Improving Search in Top-down Induction of Segmental ITGs

Markus Saers, Dekai Wu
2014 Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation  
We show that there are situations where iteratively segmenting sentence pairs topdown will fail to reach valid segments and propose a method for alleviating the problem. Due to the enormity of the search space, error analysis has indicated that it is often impossible to get to a desired embedded segment purely through binary segmentation that divides existing segmental rules in half -the strategy typically employed by existing search strategies -as it requires two steps. We propose a new method
more » ... ropose a new method to hypothesize ternary segmentations in a single step, making the embedded segments immediately discoverable.
doi:10.3115/v1/w14-4010 dblp:conf/ssst/SaersW14 fatcat:ttzgf7o7rfduvfugnnjhnn443u