Examining multiple sources of differential item functioning on the Clinician & Group CAHPS® survey

Health Serv Res. 2011 Dec;46(6pt1):1778-802. doi: 10.1111/j.1475-6773.2011.01299.x. Epub 2011 Aug 11.


Objective: To evaluate psychometric properties of a widely used patient experience survey.

Data sources: English-language responses to the Clinician & Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS®) survey (n = 12,244) from a 2008 quality improvement initiative involving eight southern California medical groups.

Methods: We used an iterative hybrid ordinal logistic regression/item response theory differential item functioning (DIF) algorithm to identify items with DIF related to patient sociodemographic characteristics, duration of the physician-patient relationship, number of physician visits, and self-rated physical and mental health. We accounted for all sources of DIF and determined its cumulative impact.

Principal findings: The upper end of the CG-CAHPS® performance range is measured with low precision. With sensitive settings, some items were found to have DIF. However, overall DIF impact was negligible, as 0.14 percent of participants had salient DIF impact. Latinos who spoke predominantly English at home had the highest prevalence of salient DIF impact at 0.26 percent.

Conclusions: The CG-CAHPS® functions similarly across commercially insured respondents from diverse backgrounds. Consequently, previously documented racial and ethnic group differences likely reflect true differences rather than measurement bias. The impact of low precision at the upper end of the scale should be clarified.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Age Factors
  • Algorithms
  • Body Mass Index
  • Educational Status
  • Ethnicity
  • Female
  • Health Status
  • Humans
  • Language
  • Logistic Models
  • Male
  • Mental Health
  • Middle Aged
  • Patient Satisfaction*
  • Physician-Patient Relations*
  • Primary Health Care*
  • Psychometrics
  • Racial Groups
  • Sex Factors
  • Surveys and Questionnaires*