Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2014 Jul;34(5):560-6.
doi: 10.1177/0272989X14528381. Epub 2014 Apr 8.

"It's Valid and Reliable" Is Not Enough: Critical Appraisal of Reporting of Measures in Trials Evaluating Patient Decision Aids

Karen R Sepucha  1 , Daniel D Matlock  2 , Celia E Wills  3 , Mary Ropka  4 , Natalie Joseph-Williams  5 , Dawn Stacey  6 , ChirkJenn Ng  7 , Carrie Levin  8 , Joanne Lally  9 , Cornelia M Borkhoff  10 , Richard Thomson  9
Affiliations
Review

"It's Valid and Reliable" Is Not Enough: Critical Appraisal of Reporting of Measures in Trials Evaluating Patient Decision Aids

Karen R Sepucha et al. Med Decis Making. 2014 Jul.

Abstract

Background: This review systematically appraises the quality of reporting of measures used in trials to evaluate the effectiveness of patient decision aids (PtDAs) and presents recommendations for minimum reporting standards.

Methods: We reviewed measures of decision quality and decision process in 86 randomized controlled trials (RCTs) from the 2011 Cochrane Collaboration systematic review of PtDAs. Data on development of the measures, reliability, validity, responsiveness, precision, interpretability, feasibility, and acceptability were independently abstracted by 2 reviewers.

Results: Information from 178 instances of use of measures was abstracted. Very few studies reported data on the performance of measures, with reliability (21%) and validity (16%) being the most common. Studies using new measures were less likely to include information about their psychometric performance. The review was limited to reporting of measures in studies included in the Cochrane review and did not consult prior publications.

Conclusions: Very little is reported about the development or performance of measures used to evaluate the effectiveness of PtDAs in published trials. Minimum reporting standards are proposed to enable authors to prepare study reports, editors and reviewers to evaluate submitted papers, and readers to appraise published studies.

Keywords: decision aids; decision making; psychometrics.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Institute of Medicine. Crossing the quality chasm: A new health system for the 21st century. Mar 1-8, 2001. - PubMed
    1. Oshima EL, Emanuel EJ. Shared Decision Making to Improve Care and Reduce Costs. N Engl J Med. 2013;368(1):6–8. - PubMed
    1. Sechrest L, McKnight P, McKnight K. Calibration of measures for psychotherapy outcome studies. Am Psychol. 1996;51(10):1065–1071. - PubMed
    1. Sepucha KR, Borkhoff CM, Lally J, Levin CA, Matlock DD, Ng CJ, et al. Establishing the effectiveness of patient decision aids: key constructs and measurement instruments. BMC Medical Informatics and Decision Making. 2013;13(Suppl 2):S12. - PMC - PubMed
    1. Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database of Systematic Reviews. 2011 doi: 10.1002/14651858.CD001431.pub3. 10, Art. No.: CD001431. - DOI - PubMed

LinkOut - more resources