Rasch analysis reveals problems with multiplicative scoring in the macular disease quality of life questionnaire

Ophthalmology. 2012 Nov;119(11):2351-7. doi: 10.1016/j.ophtha.2012.05.031. Epub 2012 Sep 8.

Abstract

Purpose: To evaluate validity and psychometric characteristics of the Macular Disease Quality of Life questionnaire (MacDQoL), a multiplicative rating scale designed to measure vision-related quality of life (VRQoL) in macular diseases and age-related macular degeneration (AMD).

Design: Cross-sectional study.

Participants: We included 108 patients with neovascular AMD at baseline before ranibizumab treatment.

Methods: The psychometric properties of the MacDQoL were assessed using Rasch analysis, exploring key indices such as response category functioning, instrument unidimensionality, discriminant ability, and targeting of item difficulty to patient ability.

Main outcome measures: Measurement characteristics of the MacDQoL.

Results: In the MacDQoL's native form, the majority of response categories were underutilized and thresholds disordered. This could not be remedied without eliminating the importance ratings owing to the ambiguous nature of the response categories. Scaling problems were resolved by using the impairment rating scale only and collapsing response categories to 4. However, the MacDQoL was multidimensional, necessitating the omission of a number of items and splitting it into an activity limitation and mobility and a socioemotional well-being scale. This improved the psychometric parameters of the revised MacDQoL, although no correlation with clinical measures such as visual acuity was found.

Conclusions: The multiplicative rating scale of the MacDQoL is flawed and does not provide scientific measurement of VRQoL. Measurement can be restored with a series of revisions to the instrument. This study reinforces the importance of considering rating scale design when choosing patient reported outcomes instruments for healthcare research.

Publication types

  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Aged
  • Angiogenesis Inhibitors / therapeutic use
  • Antibodies, Monoclonal, Humanized / therapeutic use
  • Cross-Sectional Studies
  • Female
  • Fluorescein Angiography
  • Humans
  • Language
  • Male
  • Psychometrics / instrumentation*
  • Quality of Life*
  • Ranibizumab
  • Reproducibility of Results
  • Retinal Diseases / drug therapy
  • Retinal Diseases / psychology*
  • Sickness Impact Profile*
  • Surveys and Questionnaires*
  • Vision Disorders / psychology*
  • Visual Acuity / physiology
  • Wet Macular Degeneration / drug therapy
  • Wet Macular Degeneration / psychology

Substances

  • Angiogenesis Inhibitors
  • Antibodies, Monoclonal, Humanized
  • Ranibizumab