Evaluation of an item bank for a computerized adaptive test of activity in children with cerebral palsy

Phys Ther. 2009 Jun;89(6):589-600. doi: 10.2522/ptj.20090007. Epub 2009 May 7.

Abstract

Background: Contemporary clinical assessments of activity are needed across the age span for children with cerebral palsy (CP). Computerized adaptive testing (CAT) has the potential to efficiently administer items for children across wide age spans and functional levels.

Objective: The objective of this study was to examine the psychometric properties of a new item bank and simulated computerized adaptive test to assess activity level abilities in children with CP.

Design: This was a cross-sectional item calibration study.

Methods: The convenience sample consisted of 308 children and youth with CP, aged 2 to 20 years (X=10.7, SD=4.0), recruited from 4 pediatric hospitals. We collected parent-report data on an initial set of 45 activity items. Using an Item Response Theory (IRT) approach, we compared estimated scores from the activity item bank with concurrent instruments, examined discriminate validity, and developed computer simulations of a CAT algorithm with multiple stop rules to evaluate scale coverage, score agreement with CAT algorithms, and discriminant and concurrent validity.

Results: Confirmatory factor analysis supported scale unidimensionality, local item dependence, and invariance. Scores from the computer simulations of the prototype CATs with varying stop rules were consistent with scores from the full item bank (r=.93-.98). The activity summary scores discriminated across levels of upper-extremity and gross motor severity and were correlated with the Pediatric

Outcomes: Data Collection Instrument (PODCI) physical function and sports subscale (r=.86), the Functional Independence Measure for Children (Wee-FIM) (r=.79), and the Pediatric Quality of Life Inventory-Cerebral Palsy version (r=.74).

Limitations: The sample size was small for such IRT item banks and CAT development studies. Another limitation was oversampling of children with CP at higher functioning levels.

Conclusions: The new activity item bank appears to have promise for use in a CAT application for the assessment of activity abilities in children with CP across a wide age range and different levels of motor severity.

Publication types

  • Evaluation Study
  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Activities of Daily Living
  • Adaptation, Physiological
  • Adolescent
  • Calibration
  • Cerebral Palsy / physiopathology*
  • Cerebral Palsy / rehabilitation
  • Child
  • Child, Preschool
  • Cross-Sectional Studies
  • Disability Evaluation*
  • Discriminant Analysis
  • Factor Analysis, Statistical
  • Female
  • Humans
  • Infant
  • Logistic Models
  • Male
  • Psychometrics
  • Young Adult