On the (non)utility of Juilland'sDto measure lexical dispersion in large corpora

Douglas Biber, Randi Reppen, Erin Schnur, Romy Ghanem
2016 International Journal of Corpus Linguistics  
This paper explores the effectiveness of Juilland'sDas a measure of vocabulary dispersion in large corpora. Through a series of experiments using the BNC, we explored the influence of three variables: the number of corpus-parts used for the computation ofD, the frequency of the target word, and the distributions of those words. The experiments demonstrate that the effective range forDis greatly reduced when computations are based on a large number of corpus-parts: even words with highly skewed
more » ... istributions haveDvalues indicating a relatively uniform distribution. We also briefly explore an alternative measure, Gries'DP(Gries 2008), showing that it is a more reliable and effective measure of dispersion in a large corpus divided into many parts. In conclusion, we discuss the implications of these findings for quantitative methods applied to the creation of vocabulary lists as well as research questions in other areas of corpus linguistics.
doi:10.1075/ijcl.21.4.01bib fatcat:wwqzhpxyzjblzlgjqcb4f423y4