More precise methods for national research citation impact comparisons

Ruth Fairclough, Mike Thelwall
<span title="">2015</span> <i title="Elsevier BV"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/j3avppj6indpvnps3s3x54zboe" style="color: black;">Journal of Informetrics</a> </i> &nbsp;
Governments sometimes need to analyse sets of research papers within a field in order to monitor progress, assess the effect of recent policy changes, or identify areas of excellence. They may compare the average citation impacts of the papers by dividing them by the world average for the field and year. Since citation data is highly skewed, however, simple averages may be too imprecise to robustly identify differences within, rather than across, fields. In response, this article introduces two
more &raquo; ... new methods to identify national differences in average citation impact, one based on linear modelling for normalised data and the other using the geometric mean. Results from a sample of 26 Scopus fields between 2009-2015 show that geometric means are the most precise and so are recommended for smaller sample sizes, such as for individual fields. The regression method has the advantage of distinguishing between national contributions to internationally collaborative articles, but has substantially wider confidence intervals than the geometric mean, undermining its value for any except the largest sample sizes.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.joi.2015.09.005">doi:10.1016/j.joi.2015.09.005</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/zejdrarmajgtro37p44ntqfeaa">fatcat:zejdrarmajgtro37p44ntqfeaa</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200321125550/http://www.scit.wlv.ac.uk/~cm1993/papers/NationalResearchComparisonsByField_preprint.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/2c/e1/2ce1dc62869ff581be78aebca8e7aa94ff320929.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.joi.2015.09.005"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> elsevier.com </button> </a>