Generating Chinese Classical Poems with RNN Encoder-Decoder [chapter]

Xiaoyuan Yi, Ruoyu Li, Maosong Sun
2017 Lecture Notes in Computer Science  
This paper examines the generalization abilities of encoder-decoder networks on a class of subregular functions characteristic of natural language reduplication. We find that, for the simulations we run, attention is a necessary and sufficient mechanism for learning generalizable reduplication. We examine attention alignment to connect RNN computation to a class of 2-way transducers.
doi:10.1007/978-3-319-69005-6_18 fatcat:o6ipo2tecrg6tpvvo76nocvqzu