Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2017 Sep 1;196(5):621-627.
doi: 10.1164/rccm.201705-0926OC.

A Comparative Analysis of Pulmonary and Critical Care Medicine Guideline Development Methodologies

Affiliations
Free PMC article
Comparative Study

A Comparative Analysis of Pulmonary and Critical Care Medicine Guideline Development Methodologies

Noah C Schoenberg et al. Am J Respir Crit Care Med. .
Free PMC article

Abstract

Rationale: The Institute of Medicine (IOM) standards for guideline development have had unintended negative consequences. A more efficient approach is desirable.

Objectives: To determine whether a modified Delphi process early during guideline development discriminates recommendations that should be informed by a systematic review from those that can be based upon expert consensus.

Methods: The same questions addressed by IOM-compliant pulmonary or critical care guidelines were addressed by expert panels using a modified Delphi process, termed the Convergence of Opinion on Recommendations and Evidence (CORE) process. The resulting recommendations were compared. Concordance of the course of action, strength of recommendation, and quality of evidence, as well as the duration of recommendation development, were measured.

Measurements and main results: When 50% agreement was required to make a recommendation, all questions yielded recommendations, and the recommended courses of action were 89.6% concordant. When 70% agreement was required, 17.9% of questions did not yield recommendations, but for those that did, the recommended courses of action were 98.2% concordant. The time to completion was shorter for the CORE process (median, 19.3 vs. 1,309.0 d; P = 0.0002).

Conclusions: We propose the CORE process as an early step in guideline creation. Questions for which 70% agreement on a recommendation cannot be achieved should go through an IOM-compliant process; however, questions for which 70% agreement on a recommendation can be achieved can be accepted, avoiding a lengthy systematic review.

Keywords: Grading of Recommendations, Assessment, Development, and Evaluation approach; Institute of Medicine standards for trustworthy guidelines; clinical practice guidelines; methodology.

Figures

Figure 1.
Figure 1.
The Convergence of Opinion on Recommendations and Evidence process. IOM = Institute of Medicine.
Figure 2.
Figure 2.
Proposed Convergence of Opinion on Recommendations and Evidence (CORE) process utilization algorithm. IOM = Institute of Medicine.

Comment in

  • Developing Clinical Guidelines: 99% Faster Is Not Enough.
    Krishnan JA. Krishnan JA. Am J Respir Crit Care Med. 2017 Sep 1;196(5):543-544. doi: 10.1164/rccm.201707-1542ED. Am J Respir Crit Care Med. 2017. PMID: 28759263 No abstract available.
  • Developing Clinical Guidelines.
    Morice AH, Hart S, Millqvist E. Morice AH, et al. Am J Respir Crit Care Med. 2018 Mar 15;197(6):837. doi: 10.1164/rccm.201708-1754LE. Am J Respir Crit Care Med. 2018. PMID: 29087207 No abstract available.
  • Reply to Morice et al.: Developing Clinical Guidelines.
    Schoenberg NC, Wilson KC. Schoenberg NC, et al. Am J Respir Crit Care Med. 2018 Mar 15;197(6):837-838. doi: 10.1164/rccm.201710-2039LE. Am J Respir Crit Care Med. 2018. PMID: 29087210 Free PMC article. No abstract available.
  • Have We Not Learned from Past Mistakes?
    Shah R, Morgan RL, Falck-Ytter Y, Mustafa RA. Shah R, et al. Am J Respir Crit Care Med. 2018 Jun 1;197(11):1499-1500. doi: 10.1164/rccm.201711-2200LE. Am J Respir Crit Care Med. 2018. PMID: 29345959 No abstract available.
  • No Room for Error in Medicine-A Case of Déjà Vu.
    Schünemann HJ, Brożek JL. Schünemann HJ, et al. Am J Respir Crit Care Med. 2018 Jun 1;197(11):1501-1502. doi: 10.1164/rccm.201710-2076LE. Am J Respir Crit Care Med. 2018. PMID: 29345966 No abstract available.
  • Reply to Dahm et al., to Shah et al., and to Schünemann and Brożek.
    Schoenberg NC, Wilson KC; all authors. Schoenberg NC, et al. Am J Respir Crit Care Med. 2018 Jun 1;197(11):1502-1503. doi: 10.1164/rccm.201712-2433LE. Am J Respir Crit Care Med. 2018. PMID: 29345969 No abstract available.
  • A Blast from the Past-Back to the 1970s.
    Dahm P, Sultan S, Murad MH. Dahm P, et al. Am J Respir Crit Care Med. 2018 Jun 1;197(11):1500-1501. doi: 10.1164/rccm.201711-2186LE. Am J Respir Crit Care Med. 2018. PMID: 29345971 No abstract available.

Similar articles

See all similar articles

Cited by 5 articles

Publication types

Feedback