Word-length Entropies and Correlations of Natural Language Written Texts

Maria Kalimeri, Vassilios Constantoudis, Constantinos Papadimitriou, Konstantinos Karamanos, Fotis K. Diakonos, Harris Papageorgiou
<span title="2015-03-19">2015</span> <i title="Informa UK Limited"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/i7udnr7j5fcrhl7yrocvub4jpa" style="color: black;">Journal of Quantitative Linguistics</a> </i> &nbsp;
We study the frequency distributions and correlations of the word lengths of ten European languages. Our findings indicate that a) the word-length distribution of short words quantified by the mean value and the entropy distinguishes the Uralic (Finnish) corpus from the others, b) the tails at long words, manifested in the high-order moments of the distributions, differentiate the Germanic languages (except for English) from the Romanic languages and Greek and c) the correlations between nearby
more &raquo; ... word lengths measured by the comparison of the real entropies with those of the shuffled texts are found to be smaller in the case of Germanic and Finnish languages.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1080/09296174.2014.1001636">doi:10.1080/09296174.2014.1001636</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/qdyrjbam4vadzfrxdif4kkpbti">fatcat:qdyrjbam4vadzfrxdif4kkpbti</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20190223135554/http://pdfs.semanticscholar.org/461f/8353309a6b338f79812a9ddcf5c16f68a621.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/46/1f/461f8353309a6b338f79812a9ddcf5c16f68a621.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1080/09296174.2014.1001636"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> tandfonline.com </button> </a>