Essentials of Statistical Methods for Assessing Reliability and Agreement in Quantitative Imaging

Abstract

Quantitative imaging is increasing in almost all fields of radiological science. Modern quantitative imaging biomarkers measure complex parameters including metabolism, tissue microenvironment, tissue chemical properties or physical properties. In this paper, we focus on measurement reliability assessment in quantitative imaging. We review essential concepts related to measurement such as measurement variability and measurement error. We also discuss reliability study methods for intraobserver and interobserver variability, and the applicable statistical tests including: intraclass correlation coefficient, Pearson correlation coefficient, and Bland-Altman graphs and limits of agreement, standard error of measurement, and coefficient of variation.

Keywords: Bland-Altman graph; Measurement error; agreement; coefficient of variation; intraclass correlation coefficient; reliability; standard error of measurement.