Validity and reliability of the Patient-Reported Outcomes Measurement Information System (PROMIS®) using computerized adaptive testing in patients with advanced chronic kidney disease

Esmee M van der Willik; Fenna van Breda; Brigit C van Jaarsveld; Marlon van de Putte; Isabelle W Jetten; Friedo W Dekker; Yvette Meuleman; Frans J van Ittersum; Caroline B Terwee

doi:10.1093/ndt/gfac231

Validity and reliability of the Patient-Reported Outcomes Measurement Information System (PROMIS®) using computerized adaptive testing in patients with advanced chronic kidney disease

Nephrol Dial Transplant. 2023 May 4;38(5):1158-1169. doi: 10.1093/ndt/gfac231.

Authors

Esmee M van der Willik^{1

2}, Fenna van Breda³, Brigit C van Jaarsveld³, Marlon van de Putte³, Isabelle W Jetten³, Friedo W Dekker², Yvette Meuleman², Frans J van Ittersum³, Caroline B Terwee¹

Affiliations

¹ Department of Epidemiology and Data Science, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health research institute, Amsterdam, The Netherlands.
² Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
³ Department of Nephrology, Amsterdam University Medical Centers, Amsterdam, The Netherlands.

Abstract

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS®) has been recommended for computerized adaptive testing (CAT) of health-related quality of life. This study compared the content, validity, and reliability of seven PROMIS CATs to the 12-item Short-Form Health Survey (SF-12) in patients with advanced chronic kidney disease.

Methods: Adult patients with chronic kidney disease and an estimated glomerular filtration rate under 30 mL/min/1.73 m2 who were not receiving dialysis treatment completed seven PROMIS CATs (assessing physical function, pain interference, fatigue, sleep disturbance, anxiety, depression, and the ability to participate in social roles and activities), the SF-12, and the PROMIS Pain Intensity single item and Dialysis Symptom Index at inclusion and 2 weeks. A content comparison was performed between PROMIS CATs and the SF-12. Construct validity of PROMIS CATs was assessed using Pearson's correlations. We assessed the test-retest reliability of all patient-reported outcome measures by calculating the intraclass correlation coefficient and minimal detectable change.

Results: In total, 207 patients participated in the study. A median of 45 items (10 minutes) were completed for PROMIS CATs. All PROMIS CATs showed evidence of sufficient construct validity. PROMIS CATs, most SF-12 domains and summary scores, and Dialysis Symptom Index showed sufficient test-retest reliability (intraclass correlation coefficient ≥ 0.70). PROMIS CATs had a lower minimal detectable change compared with the SF-12 (range, 5.7-7.4 compared with 11.3-21.7 across domains, respectively).

Conclusion: PROMIS CATs showed sufficient construct validity and test-retest reliability in patients with advanced chronic kidney disease. PROMIS CATs required more items but showed better reliability than the SF-12. Future research is needed to investigate the feasibility of PROMIS CATs for routine nephrology care.

Keywords: chronic kidney disease (CKD); minimal detectable change; patient-reported outcome measures (PROMs); reliability; validity.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Computerized Adaptive Testing
Humans
Information Systems
Patient Reported Outcome Measures
Quality of Life*
Renal Dialysis
Renal Insufficiency, Chronic* / diagnosis
Renal Insufficiency, Chronic* / therapy
Reproducibility of Results
Surveys and Questionnaires