Is Going Beyond Rasch Analysis Necessary to Assess the Construct Validity of a Motor Function Scale?

Arch Phys Med Rehabil. 2018 Sep;99(9):1776-1782.e9. doi: 10.1016/j.apmr.2018.02.017. Epub 2018 Apr 3.

Abstract

Objective: To examine whether a Rasch analysis is sufficient to establish the construct validity of the Motor Function Measure (MFM) and discuss whether weighting the MFM item scores would improve the MFM construct validity.

Design: Observational cross-sectional multicenter study.

Setting: Twenty-three physical medicine departments, neurology departments, or reference centers for neuromuscular diseases.

Participants: Patients (N=911) aged 6 to 60 years with Charcot-Marie-Tooth disease (CMT), facioscapulohumeral dystrophy (FSHD), or myotonic dystrophy type 1 (DM1).

Interventions: None.

Main outcome measure(s): Comparison of the goodness-of-fit of the confirmatory factor analysis (CFA) model vs that of a modified multidimensional Rasch model on MFM item scores in each considered disease.

Results: The CFA model showed good fit to the data and significantly better goodness of fit than the modified multidimensional Rasch model regardless of the disease (P<.001). Statistically significant differences in item standardized factor loadings were found between DM1, CMT, and FSHD in only 6 of 32 items (items 6, 27, 2, 7, 9 and 17).

Conclusions: For multidimensional scales designed to measure patient abilities in various diseases, a Rasch analysis might not be the most convenient, whereas a CFA is able to establish the scale construct validity and provide weights to adapt the item scores to a specific disease.

Keywords: Factor analysis; Neuromuscular diseases; Outcome measure; Psychometrics.

Publication types

  • Multicenter Study
  • Observational Study
  • Validation Study

MeSH terms

  • Adolescent
  • Adult
  • Charcot-Marie-Tooth Disease / diagnosis*
  • Charcot-Marie-Tooth Disease / physiopathology
  • Child
  • Cross-Sectional Studies
  • Disability Evaluation*
  • Factor Analysis, Statistical
  • Female
  • Humans
  • Male
  • Middle Aged
  • Motor Skills
  • Muscular Dystrophy, Facioscapulohumeral / diagnosis*
  • Muscular Dystrophy, Facioscapulohumeral / physiopathology
  • Myotonic Dystrophy / diagnosis*
  • Myotonic Dystrophy / physiopathology
  • Psychometrics
  • Reproducibility of Results
  • Surveys and Questionnaires / standards*
  • Young Adult