300 Hits in 2.0 sec

A neural interlingua for multilingual machine translation [article]

Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
2018 arXiv   pre-print
We incorporate an explicit neural interlingua into a multilingual encoder-decoder neural machine translation (NMT) architecture.  ...  Furthermore, we show that, despite using a smaller number of parameters than a pairwise collection of bilingual NMT models, our approach produces comparable BLEU scores for each language pair in WMT15.  ...  Conclusion We incorporate a neural interlingua component into the standard encoder-decoder framework for multilingual neural machine translation, and demonstrate that the resulting model learns language-independent  ... 
arXiv:1804.08198v3 fatcat:mcxvz5zypvcydoikupzxzvetdy

A neural interlingua for multilingual machine translation

Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
2018 Proceedings of the Third Conference on Machine Translation: Research Papers  
We incorporate an explicit neural interlingua into a multilingual encoder-decoder neural machine translation (NMT) architecture.  ...  Furthermore, we show that, despite using a smaller number of parameters than a pairwise collection of bilingual NMT models, our approach produces comparable BLEU scores for each language pair in WMT15.  ...  Introduction Multilingual Machine Translation Neural machine translation (NMT) relies on word and sentence embeddings to encode the semantic information needed for translation.  ... 
doi:10.18653/v1/w18-6309 dblp:conf/wmt/LuKLBZS18 fatcat:ceiv3kpejfh2rfva5a5orh7ncm

A Brief Survey of Multilingual Neural Machine Translation [article]

Raj Dabre, Chenhui Chu, Anoop Kunchukuttan
2020 arXiv   pre-print
We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years.  ...  Many approaches have been proposed in order to exploit multilingual parallel corpora for improving translation quality.  ...  A neural interlingua for multilingual machine translation. In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 84-92. Association for Computational Linguistics.  ... 
arXiv:1905.05395v3 fatcat:cyufmt3y65bhjofvt5zeljahz4

From Feature to Paradigm: Deep Learning in Machine Translation (Extended Abstract)

Marta R. Costa-jussà
2018 Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence  
The specific field of Machine Translation (MT) has not remained invariant.  ...  word alignment, translation, reordering, and rescoring; and on describing the new neural MT approach together with recent approaches on using subword, characters and training with multilingual languages  ...  Kobi Gal for his invitation to participate in the IJCAI journal track.  ... 
doi:10.24963/ijcai.2018/789 dblp:conf/ijcai/Costa-Jussa18 fatcat:uwapnqtfive3zn4wbfnqmuvcbe

Byte-based Neural Machine Translation

Marta R. Costa-jussà, Carlos Escolano, José A. R. Fonollosa
2017 Proceedings of the First Workshop on Subword and Character Level Models in NLP  
The main motivation of the byte-based neural machine translation system is to build multilingual neural machine translation systems that can share the same vocabulary.  ...  byte-based neural machine translation.  ...  We want to explore multilingual characterbased neural machine translation with a diversity of languages, including languages as Chinese.  ... 
doi:10.18653/v1/w17-4123 dblp:conf/emnlp/Costa-JussaEF17 fatcat:ibujxv2mnzagbh2v7zv6jenl3y

BERT is Not an Interlingua and the Bias of Tokenization

Jasdeep Singh, Bryan McCann, Richard Socher, Caiming Xiong
2019 Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019)  
Cananical Correlation Analysis (CCA) of the internal representations of a pretrained, multilingual BERT model reveals that the model partitions representations for each language rather than using a common  ...  We release a subset of the XNLI dataset translated into an additional 14 languages at https://www.github. com/salesforce/xnli_extension to assist further research into multilingual representations.  ...  Prior work in zero-shot machine translation has investigated the extent to which multilingual neural machine translation systems trained with a shared subword vocabulary Johnson et al. (2017) ; Kudugunta  ... 
doi:10.18653/v1/d19-6106 dblp:conf/acl-deeplo/SinghMSX19 fatcat:mabuawp6rzcrdjofjaqqconmbq


Jatin C. Modh
2018 International Journal of Advanced Research in Computer Science  
This paper gives a brief description of approaches of Machine Translation and the work done for the Gujarati language.  ...  Many attempts have been done in Machine Translation System for Indian languages. Unfortunately, we do not have an efficient Machine Translation System today.  ...  Analysis phase constructs a source language dependent representation, so a separate transfer component is needed for each direction of translation for every pair of languages in case of multilingual machine  ... 
doi:10.26483/ijarcs.v9i1.5266 fatcat:r6xggbyapfevlm5mpzk676br6i

Lump at SemEval-2017 Task 1: Towards an Interlingua Semantic Similarity

Cristina España-Bonet, Alberto Barrón-Cedeño
2017 Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017)  
We include lexical similarities, cross-language explicit semantic analysis, internal representations of multilingual neural networks and interlingual word embeddings.  ...  Our representations allow to use large datasets in language pairs with many instances to better classify instances in smaller language pairs avoiding the necessity of translating into a single language  ...  The research work of the second author is carried out in the framework of the Interactive sYstems for Answer Search project (IYAS), at the Qatar Computing Research Institute, HBKU.  ... 
doi:10.18653/v1/s17-2019 dblp:conf/semeval/Espana-BonetB17 fatcat:ne6rifwvpnac7n72e4rty4pwv4

Multilingual NMT with a language-independent attention bridge [article]

Raúl Vázquez, Alessandro Raganato, Jörg Tiedemann, Mathias Creutz
2018 arXiv   pre-print
This layer exploits the semantics from each language for performing translation and develops into a language-independent meaning representation that can efficiently be used for transfer learning.  ...  We present a new framework for the efficient development of multilingual NMT using this model and scheduled training. We have tested the approach in a systematic way with a multi-parallel data set.  ...  Multilingual Machine Translation addresses the task of building a system that can translate between multiple languages, either by using a many-to-one approach with several source languages to translate  ... 
arXiv:1811.00498v1 fatcat:zoeeo43txbcirljk6eyevuyd5q

Human translation vs machine translation: The practitioner phenomenology

Peng Xiu, Liming Xeauyin
2018 Linguistics and Culture Review  
Human translation (HT), by definition, is when a human translator-rather than a machine-translate text.  ...  A person who performs language translation. The translation is necessary for the spread of information, knowledge, and ideas.  ...  A common argument for the interlingua approach is economy of effort in a multilingual environment.  ... 
doi:10.37028/lingcure.v2n1.8 fatcat:y7fucayvwraflgij4ug7qnrmi4

Multilingual, Multi-scale and Multi-layer Visualization of Intermediate Representations

Carlos Escolano, Marta R. Costa-jussà, Elora Lacroux, Pere-Pau Vázquez
2019 Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP): System Demonstrations  
in the context of multilingual machine translation.  ...  The second and third are showing multilingual intermediate representations for sentences and tokens and the evolution of these intermediate representations along the multiple layers of the decoder and  ...  Acknowledgements Authors want to thank Christine Raouf Basta for sharing her expertise in contextual word embeddings. This work is supported by a Google Faculty Research Award.  ... 
doi:10.18653/v1/d19-3026 dblp:conf/emnlp/EscolanoCLV19 fatcat:zd7xzsnouvhyfhvdms5mmo6np4

Towards Interlingua Neural Machine Translation [article]

Carlos Escolano, Marta R. Costa-jussà, José A. R. Fonollosa
2019 arXiv   pre-print
Common intermediate language representation in neural machine translation can be used to extend bilingual to multilingual systems by incremental training.  ...  the system, which may be a game-changer in some situations (i.e. in a disaster crisis where international help is required towards a small region or to develop some translation system for a client).  ...  This paper proposes a proof of concept of a new multilingual neural machine translation approach.  ... 
arXiv:1905.06831v2 fatcat:ckufn7ei4nhtncftsj2wq4c2hq

A Survey on Hybrid Machine Translation

Anusha Anugu, Gajula Ramesh, S. Tummala, S. Kosaraju, P. Bobba, S. Singh
2020 E3S Web of Conferences  
Thus, we want to demonstrate an analysis of the existing techniques for machine translation including Neural Machine translation, their differences and the translation tools associated with them.  ...  The distinct models of machine translation along with "Neural Machine Translation (NMT)" is summarized in this paper.  ...  Neural Machine Translation (NMT): It is a recently proposed method utilizing special neural grid framework called Encoder-Decoder architecture [12] .  ... 
doi:10.1051/e3sconf/202018401061 fatcat:6fwsitv2wverradsybegtkm6om

Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? [article]

Zae Myung Kim, Laurent Besacier, Vassilina Nikoulina, Didier Schwab
2021 arXiv   pre-print
While most of such work has been conducted in a "black-box" manner, this paper aims to analyze individual components of a multilingual neural translation (NMT) model.  ...  Recent studies on the analysis of the multilingual representations focus on identifying whether there is an emergence of language-independent representations, or whether a multilingual model partitions  ...  ., Kwang Hee Lee from KAIST for insightful comments on the experiments. We would also like to extend our gratitude to the anonymous reviewers for their valuable feedback.  ... 
arXiv:2105.14940v1 fatcat:yup4tr2oe5cgjmhgkl34lwqqly

Machine Translation Development for Indian Languages and its Approaches

Amruta Godase, Sharvari Govilkar
2015 International Journal on Natural Language Computing  
For a multilingual country like INDIA which is largest democratic country in whole world, there is a big requirement of automatic machine translation system.  ...  This paper presents a survey of Machine translation system for Indian Regional languages. Machine translation is one of the central areas of Natural language processing (NLP).  ...  Translation rules and ANN based model for English to Urdu Machine Translation [36] 2011 English-Urdu General ANN & Rule based System uses feed- forward back- propagation artificial neural  ... 
doi:10.5121/ijnlc.2015.4205 fatcat:y76fulkcsrhzzc7bycolyfvylm
« Previous Showing results 1 — 15 out of 300 results