Unsupervised learning of agglutinated morphology using nested Pitman-Yor process based morpheme induction algorithm

Arun Kumar, Lluis Padro, Antoni Oliver
<span title="">2015</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/h22hc7srljgfxlfd7najzrblui" style="color: black;">2015 International Conference on Asian Language Processing (IALP)</a> </i> &nbsp;
In this paper we describe a method to morphologically segment highly agglutinating and inflectional languages from Dravidian family. We use nested Pitman-Yor process to segment long agglutinated words into their basic components, and use a corpus based morpheme induction algorithm to perform morpheme segmentation. We test our method in two languages, Malayalam and Kannada and compare the results with Morfessor.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/ialp.2015.7451528">doi:10.1109/ialp.2015.7451528</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/ialp/KumarPO15.html">dblp:conf/ialp/KumarPO15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/feva73iv25c53nz2jhipjzkx7i">fatcat:feva73iv25c53nz2jhipjzkx7i</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200312200350/https://upcommons.upc.edu/bitstream/handle/2117/83378/kumar15c.pdf;jsessionid=49AC632E130253D53E7416AFAA4D931A?sequence=1" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/a3/73/a37382820ff12eae1a96ccc81f670bf78b75a344.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/ialp.2015.7451528"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>