Selecting response anchors with equal intervals for summated rating scales

J Appl Psychol. 2020 Apr;105(4):390-409. doi: 10.1037/apl0000444. Epub 2019 Aug 15.

Abstract

Summated rating scales are ubiquitous in organizational research, and there are well-delineated guidelines for scale development (e.g., Hinkin, 1998). Nevertheless, there has been less research on the explicit selection of the response anchors. Constructing survey questions with equal-interval properties (i.e., interval or ratio data) is important if researchers plan to analyze their data using parametric statistics. As such, the primary objectives of the current study were to (a) determine the most common contexts in which summated rating scales are used (e.g., agreement, similarity, frequency, amount, and judgment), (b) determine the most commonly used anchors (e.g., strongly disagree, often, very good), and (c) provide empirical data on the conceptual distance between these anchors. We present the mean and standard deviation of scores for estimates of each anchor and the percentage of distribution overlap between the anchors. Our results provide researchers with data that can be used to guide the selection of verbal anchors with equal-interval properties so as to reduce measurement error and improve confidence in the results of subsequent analyses. We also conducted multiple empirical studies to examine the consequences of measuring constructs with unequal-interval anchors. A clear pattern of results is that correlations involving unequal-interval anchors are consistently weaker than correlations involving equal-interval anchors. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

MeSH terms

  • Humans
  • Psychology, Applied / instrumentation*
  • Psychology, Applied / methods*
  • Psychometrics / instrumentation*
  • Psychometrics / methods*