A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

doi:10.1007/s00134-010-1786-8

Review

. 2010 Oct;36(10):1636-1643.

doi: 10.1007/s00134-010-1786-8. Epub 2010 Mar 9.

A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

Sean K Gorman¹, Michelle Ho Chung², Richard S Slavik³, Peter J Zed^{4

5}, Kerry Wilbur⁶, Vinay K Dhingra^{7

8}

Affiliations

¹ Department of Pharmacy, Capital District Health Authority, College of Pharmacy, Dalhousie University, c/o Rm 2043 Victoria Building, 1276 South Park Street, Halifax, NS, B3H 2Y9, Canada. sean.gorman@dal.ca.
² Department of Pharmacy, St. Paul's Hospital, 1081 Burrard Street, Vancouver, BC, V6Z 1Y6, Canada.
³ Pharmacy Department, Interior Health Authority, Faculty of Pharmaceutical Sciences, University of British Columbia, 200-1835 Gordon Drive, Kelowna, BC, V1Y 3H5, Canada.
⁴ Department of Pharmacy, Capital District Health Authority, College of Pharmacy, Dalhousie University, c/o Rm 2043 Victoria Building, 1276 South Park Street, Halifax, NS, B3H 2Y9, Canada.
⁵ Department of Emergency Medicine, Dalhousie University, Halifax Infirmary, Suite 355 (Room 345), 1796 Summer Street, Halifax, NS, B3H 3A7, Canada.
⁶ College of Pharmacy, Qatar University, P.O. Box 2713, Doha, Qatar.
⁷ Intensive Care Unit, Vancouver General Hospital, 855 West 12th Avenue, Vancouver, BC, V5Z 1M9, Canada.
⁸ Faculty of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada.

PMID: 20217048
DOI: 10.1007/s00134-010-1786-8

Review

A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

Sean K Gorman et al. Intensive Care Med. 2010 Oct.

. 2010 Oct;36(10):1636-1643.

doi: 10.1007/s00134-010-1786-8. Epub 2010 Mar 9.

Authors

Sean K Gorman¹, Michelle Ho Chung², Richard S Slavik³, Peter J Zed^{4

5}, Kerry Wilbur⁶, Vinay K Dhingra^{7

8}

Affiliations

¹ Department of Pharmacy, Capital District Health Authority, College of Pharmacy, Dalhousie University, c/o Rm 2043 Victoria Building, 1276 South Park Street, Halifax, NS, B3H 2Y9, Canada. sean.gorman@dal.ca.
² Department of Pharmacy, St. Paul's Hospital, 1081 Burrard Street, Vancouver, BC, V6Z 1Y6, Canada.
³ Pharmacy Department, Interior Health Authority, Faculty of Pharmaceutical Sciences, University of British Columbia, 200-1835 Gordon Drive, Kelowna, BC, V1Y 3H5, Canada.
⁴ Department of Pharmacy, Capital District Health Authority, College of Pharmacy, Dalhousie University, c/o Rm 2043 Victoria Building, 1276 South Park Street, Halifax, NS, B3H 2Y9, Canada.
⁵ Department of Emergency Medicine, Dalhousie University, Halifax Infirmary, Suite 355 (Room 345), 1796 Summer Street, Halifax, NS, B3H 3A7, Canada.
⁶ College of Pharmacy, Qatar University, P.O. Box 2713, Doha, Qatar.
⁷ Intensive Care Unit, Vancouver General Hospital, 855 West 12th Avenue, Vancouver, BC, V5Z 1M9, Canada.
⁸ Faculty of Medicine, University of British Columbia, Vancouver, BC, V5Z 1M9, Canada.

PMID: 20217048
DOI: 10.1007/s00134-010-1786-8

Erratum in

Intensive Care Med. 2010 Oct;36(10):1798-1801

Abstract

Objective: Clinical practice guideline (CPG) quality assessment is important before applying their recommendations. Determining whether recommendation strength is consistent with supporting quality of evidence is also essential. We aimed to determine quality of critical care pharmacotherapy CPGs and to assess whether high quality evidence supports strong pharmacotherapy recommendations.

Methods: MEDLINE (1966-February 2008), EMBASE (1980-February 2008), National Guideline Clearinghouse (February 2008) and personal files were searched to identify CPGs. Four appraisers evaluated each guideline using the appraisal of guidelines, research and evaluation (AGREE) instrument. AGREE assesses 23 items in six domains that include scope/purpose, stakeholder involvement, rigor of development, clarity, applicability and editorial independence. Standardized domain scores (0-100%) were determined to decide whether to recommend a guideline for use. One appraiser extracted strong pharmacotherapy recommendations and supporting evidence quality.

Results: Twenty-four CPGs were included. Standardized domain scores were clarity [69% (95% confidence interval (CI) 62-76%)], scope/purpose [62% (95% CI 55-68%)], rigor of development [51% (95% CI 42-60%)], editorial independence [39% (95% CI 26-52%)], stakeholder involvement [32% (95% CI 26-37%)] and applicability [19% (95% CI 12-26%)]. The proportion of guidelines that could be strongly recommended, recommended with alterations and not recommended was 25, 37.5 and 37.5%, respectively. High quality evidence supported 36% of strong pharmacotherapy recommendations.

Conclusion: Variation in AGREE domain scores explain why one-third of critical care pharmacotherapy CPGs cannot be recommended. Only one-third of strong pharmacotherapy recommendations were supported by high quality evidence. We recommend appraisal of guideline quality and the caliber of supporting evidence prior to applying recommendations.

PubMed Disclaimer

Cited by

Appraisal of the Quality and Contents of Clinical Practice Guidelines for Hypertension Management in Chinese Medicine: A Systematic Review.
Yuwen Y, Han XJ, Weng WL, Zhao XY, Liu YQ, Li WQ, Liu DS, Wang YP, Lu AP. Yuwen Y, et al. Chin J Integr Med. 2018 Jul;24(7):545-550. doi: 10.1007/s11655-016-2277-8. Epub 2016 Dec 9. Chin J Integr Med. 2018. PMID: 27933511 Review.
Critical appraisal of clinical practice guidelines in pediatric infectious diseases.
Wilby KJ, Black EK, MacLeod C, Wiens M, Lau TT, Paiva MA, Gorman S. Wilby KJ, et al. Int J Clin Pharm. 2015 Oct;37(5):799-807. doi: 10.1007/s11096-015-0123-2. Epub 2015 Apr 25. Int J Clin Pharm. 2015. PMID: 25910479
Rigorous method to assess quality and generalizability of clinical practice guidelines.
Farghali AA, Al-Khawaja R, Madi L, Elbardissy A, Hamdy HM, Wilby KJ. Farghali AA, et al. Can J Hosp Pharm. 2014 Sep;67(5):397-8. doi: 10.4212/cjhp.v67i5.1397. Can J Hosp Pharm. 2014. PMID: 25364025 Free PMC article. No abstract available.
Appraisal of clinical practice guidelines for ischemic stroke management in Chinese medicine with appraisal of guidelines for research and evaluation instrument: A systematic review.
Yuwen Y, Shi NN, Han XJ, Gao Y, Xu JL, Liu DS, Ng B, Tsui D, Zhong LD, Ziea E, Bian ZX, Lu AP. Yuwen Y, et al. Chin J Integr Med. 2015 Sep;21(9):707-15. doi: 10.1007/s11655-014-1834-2. Epub 2014 Jun 18. Chin J Integr Med. 2015. PMID: 24938446 Review.
Methodological quality of English-language genetic guidelines on hereditary breast-cancer screening and management: an evaluation using the AGREE instrument.
Simone B, De Feo E, Nicolotti N, Ricciardi W, Boccia S. Simone B, et al. BMC Med. 2012 Nov 21;10:143. doi: 10.1186/1741-7015-10-143. BMC Med. 2012. PMID: 23171648 Free PMC article.

See all "Cited by" articles

References

1. Field MJ, Lohr KN (1992) Guidelines for clinical practice: from development to use. National Academy Press, Washington
1. Gundersen L (2000) The effect of clinical practice guidelines on variations in care. Ann Intern Med 133:317–318 - PubMed
1. Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D (2005) A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 17:235–242 - DOI - PubMed
1. Tricoci P, Allen JM, Kramer JM, Califf RM, Smith SC (2009) Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA 301:831–841 - DOI - PubMed
1. The AGREE Collaboration (2001) Appraisal of guidelines for research and evaluation (AGREE) instrument. http://www.agreecollaboration.org/pdf/agreeinstrumentfinal.pdf . Accessed 23 Jul 2007

Publication types

Actions
Actions

MeSH terms

Actions
Actions
Actions
Actions

LinkOut - more resources

Full Text Sources
- Ovid Technologies, Inc.
- Springer
Medical
- MedlinePlus Health Information

[1] Field MJ, Lohr KN (1992) Guidelines for clinical practice: from development to use. National Academy Press, Washington

[2] Field MJ, Lohr KN (1992) Guidelines for clinical practice: from development to use. National Academy Press, Washington

[3] Gundersen L (2000) The effect of clinical practice guidelines on variations in care. Ann Intern Med 133:317–318 - PubMed

[4] Gundersen L (2000) The effect of clinical practice guidelines on variations in care. Ann Intern Med 133:317–318 - PubMed

[5] Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D (2005) A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 17:235–242 - DOI - PubMed

[6] Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D (2005) A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care 17:235–242 - DOI - PubMed

[7] Tricoci P, Allen JM, Kramer JM, Califf RM, Smith SC (2009) Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA 301:831–841 - DOI - PubMed

[8] Tricoci P, Allen JM, Kramer JM, Califf RM, Smith SC (2009) Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA 301:831–841 - DOI - PubMed

[9] The AGREE Collaboration (2001) Appraisal of guidelines for research and evaluation (AGREE) instrument. http://www.agreecollaboration.org/pdf/agreeinstrumentfinal.pdf . Accessed 23 Jul 2007

[10] The AGREE Collaboration (2001) Appraisal of guidelines for research and evaluation (AGREE) instrument. http://www.agreecollaboration.org/pdf/agreeinstrumentfinal.pdf . Accessed 23 Jul 2007

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

Affiliations

A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

Authors

Affiliations

Erratum in

Abstract

Similar articles

Cited by

References

Publication types

MeSH terms

LinkOut - more resources

Full Text Sources

Medical