Using TectoMT as a Preprocessing Tool for Phrase-Based Statistical Machine Translation [chapter]

Daniel Zeman
2010 Lecture Notes in Computer Science  
We present a systematic comparison of preprocessing techniques for two language pairs: English-Czech and English-Hindi. The two target languages, although both belonging to the Indo-European language family, show significant differences in morphology, syntax and word order. We describe how TectoMT, a successful framework for analysis and generation of language, can be used as preprocessor for a phrasebased MT system. We compare the two language pairs and the optimal sets of source-language
more » ... formations applied to them. The following transformations are examples of possible preprocessing steps: lemmatization; retokenization, compound splitting; removing/adding words lacking counterparts in the other language; phrase reordering to resemble the target word order; marking syntactic functions. TectoMT, as well as all other tools and data sets we use, are freely available on the Web.
doi:10.1007/978-3-642-15760-8_28 fatcat:ee27wbvfrvh25eaqlbiwiusngy