The Importance of the Assumption of Uncorrelated Errors in Psychometric Theory

Educ Psychol Meas. 2015 Aug;75(4):634-647. doi: 10.1177/0013164414548217. Epub 2014 Aug 27.

Abstract

A critical discussion of the assumption of uncorrelated errors in classical psychometric theory and its applications is provided. It is pointed out that this assumption is essential for a number of fundamental results and underlies the concept of parallel tests, the Spearman-Brown's prophecy and the correction for attenuation formulas as well as the discrepancy between observed and true correlations, and the upper bound property of the reliability index with respect to validity. These relationships are shown not to hold if the errors of considered pairs of tests are correlated. The assumption of lack of error correlation is demonstrated not to be testable using standard covariance structure analysis for pairs of indivisible measures evaluating the same true score with identical error variances.

Keywords: Spearman–Brown prophecy formula; attenuation; covariance structure analysis; error score; observed correlation; parallel tests; reliability; true correlation; true score; uncorrelated errors; validity.