Review of assumptions and problems in the appropriate conceptualization of effect size

Robert J. Grissom, John J. Kim
2001 Psychological methods  
Estimation of the effect size parameter, D, the standardized difference between population means, is sensitive to heterogeneity of variance (heteroscedasticity), which seems to abound in psychological data. Pooling s 2 s assumes homoscedasticity, as do methods for constructing a confidence interval for D, estimating D from t or analysis of variance results, formulas that adjust estimates for inflation by main effects or covariates, and the Q statistic. The common language effect size statistic
more » ... s an estimate of Pr(X, > X 2 ), the probability that a randomly sampled member of Population 1 will outscore a randomly sampled member of Population 2, also assumes normality and homoscedasticity. Various proposed solutions are reviewed, including measures that do not make these assumptions, such as the probability of superiority estimate of Pr(X } > X 2 ). Ways to reconceptualize effect size when treatments may affect moments such as the variance are also discussed.
doi:10.1037/1082-989x.6.2.135 pmid:11411438 fatcat:3z6wlpwytbehliywnpn7gmly24