Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores
- PMID: 19317857
- PMCID: PMC2677051
- DOI: 10.1111/j.1475-6773.2008.00914.x
Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores
Abstract
Objective: To evaluate the need for survey mode adjustments to hospital care evaluations by discharged inpatients and develop the appropriate adjustments.
Data source: A total of 7,555 respondents from a 2006 national random sample of 45 hospitals who completed the CAHPS Hospital (HCAHPS [Hospital Consumer Assessments of Healthcare Providers and Systems]) Survey.
Study design/data collection/extraction methods: We estimated mode effects in linear models that predicted each HCAHPS outcome from hospital-fixed effects and patient-mix adjustors.
Principal findings: Patients randomized to the telephone and active interactive voice response (IVR) modes provided more positive evaluations than patients randomized to mail and mixed (mail with telephone follow-up) modes, with some effects equivalent to more than 30 percentile points in hospital rankings. Mode effects are consistent across hospitals and are generally larger than total patient-mix effects. Patient-mix adjustment accounts for any nonresponse bias that could have been addressed through weighting.
Conclusions: Valid comparisons of hospital performance require that reported hospital scores be adjusted for survey mode and patient mix.
Similar articles
-
Effects of Survey Mode on Consumer Assessment of Healthcare Providers and Systems (CAHPS) Hospice Survey Scores.J Am Geriatr Soc. 2018 Mar;66(3):546-552. doi: 10.1111/jgs.15265. Epub 2018 Jan 23. J Am Geriatr Soc. 2018. PMID: 29360140
-
Equivalence of mail and telephone responses to the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2120-39. doi: 10.1111/j.1475-6773.2005.00479.x. Health Serv Res. 2005. PMID: 16316441 Free PMC article.
-
Case-mix adjustment of the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2162-81. doi: 10.1111/j.1475-6773.2005.00470.x. Health Serv Res. 2005. PMID: 16316443 Free PMC article.
-
Patterns of unit and item nonresponse in the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2096-119. doi: 10.1111/j.1475-6773.2005.00476.x. Health Serv Res. 2005. PMID: 16316440 Free PMC article.
-
Impact of case-mix on comparisons of patient-reported experience in NHS acute hospital trusts in England.J Health Serv Res Policy. 2015 Apr;20(2):92-9. doi: 10.1177/1355819614552682. Epub 2014 Oct 29. J Health Serv Res Policy. 2015. PMID: 25359566
Cited by
-
Factors influencing patient experience in hospital wards: a systematic review.BMC Nurs. 2024 Aug 1;23(1):527. doi: 10.1186/s12912-024-02054-0. BMC Nurs. 2024. PMID: 39090643 Free PMC article.
-
Factors associated with self-reports of limitations in activities of daily living among Medicare Fee-for-Service recipients.BMC Geriatr. 2024 Aug 1;24(1):648. doi: 10.1186/s12877-024-05242-4. BMC Geriatr. 2024. PMID: 39090545 Free PMC article.
-
No Association Between Medicare Advantage Providers' Network Restrictiveness and Star Rating Between 2013 and 2017: An Observational Study.J Gen Intern Med. 2024 Jul 19. doi: 10.1007/s11606-024-08938-w. Online ahead of print. J Gen Intern Med. 2024. PMID: 39028405
-
Recruitment strategies and consent rates in a national prospective colorectal cancer screening cohort: results from year 1 of the Voyage Study.BMJ Open Gastroenterol. 2024 Jul 17;11(1):e001376. doi: 10.1136/bmjgast-2024-001376. BMJ Open Gastroenterol. 2024. PMID: 39019622 Free PMC article. Clinical Trial.
-
Patient satisfaction and value based purchasing in hospitals, Odisha, India.Bull World Health Organ. 2024 Jul 1;102(7):509-520. doi: 10.2471/BLT.24.290519. Epub 2024 Jun 4. Bull World Health Organ. 2024. PMID: 38933484 Free PMC article.
References
-
- Agency for Healthcare Research and Quality. [November 15, 2007]. “Case-Mix Adjustment in CAHPS Surveys” Available at https://www.cahps.ahrq.gov/content/cahpsOverview/case_mix_adjustment.asp.
-
- Baddeley AD, Hitch GJ. Recency Re-Examined. In: Dornic S, editor. Attention and Performance IV. Hillsdale, NJ: Erlbaum; 1977. pp. 647–67.
-
- Barkley WM, Furse DH. Changing Priorities for Improvement: The Impact of Low Response Rates in Patient Satisfaction. Joint Commission Journal on Quality Improvement. 1996;22(6):427–33. - PubMed
-
- Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne DW. Patient Satisfaction Measurement Strategies: A Comparison of Phone and Mail Methods. Joint Commission Journal on Quality and Patient Safety. 2001;27(7):349–61. - PubMed
-
- Centers for Medicare & Medicaid Services. [November 15, 2007]. CAHPS Hospital Survey, Quality Assurance Guidelines, version 2.0” Available at http://www.hcahpsonline.org.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
