An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort

Ann Intern Med. 2015 Feb 17;162(4):266-75. doi: 10.7326/M14-1281.

Abstract

Background: Accurate risk assessment of atherosclerotic cardiovascular disease (ASCVD) is essential to effectively balance the risks and benefits of therapy for primary prevention.

Objective: To compare the calibration and discrimination of the new American Heart Association (AHA) and American College of Cardiology (ACC) ASCVD risk score with alternative risk scores and to explore preventive therapy as a cause of the reported risk overestimation using the AHA-ACC-ASCVD score.

Design: Prospective epidemiologic study of ASCVD.

Setting: MESA (Multi-Ethnic Study of Atherosclerosis), a community-based, sex-balanced, multiethnic cohort.

Patients: 4227 MESA participants aged 50 to 74 years and without diabetes at baseline.

Measurements: Observed and expected events for the AHA-ACC-ASCVD score were compared with 4 commonly used risk scores-and their respective end points-in MESA after a 10.2-year follow-up.

Results: The new AHA-ACC-ASCVD and 3 older Framingham-based risk scores overestimated cardiovascular events by 37% to 154% in men and 8% to 67% in women. Overestimation was noted throughout the continuum of risk. In contrast, the Reynolds Risk Score overestimated risk by 9% in men but underestimated risk by 21% in women. Aspirin, lipid-lowering or antihypertensive therapy, and interim revascularization did not explain the overestimation.

Limitation: Comparability of MESA with target populations for primary prevention and possibility of missed events in MESA.

Conclusion: Of the 5 risk scores, 4, including the new AHA-ACC-ASCVD score, showed overestimation of risk (25% to 115%) in a modern, multiethnic cohort without baseline clinical ASCVD. If validated, overestimation of ASCVD risk may have substantial implications for individual patients and the health care system.

Primary funding source: National Heart, Lung, and Blood Institute.

Publication types

  • Multicenter Study
  • Research Support, N.I.H., Extramural

MeSH terms

  • Aged
  • Aged, 80 and over
  • American Heart Association
  • Antihypertensive Agents / therapeutic use
  • Aspirin / therapeutic use
  • Calibration
  • Coronary Artery Disease / epidemiology*
  • Coronary Artery Disease / ethnology
  • Coronary Artery Disease / prevention & control
  • Diabetes Complications
  • Female
  • Follow-Up Studies
  • Humans
  • Hypolipidemic Agents / therapeutic use
  • Male
  • Middle Aged
  • Myocardial Revascularization
  • Platelet Aggregation Inhibitors / therapeutic use
  • Practice Guidelines as Topic
  • Primary Prevention
  • Prospective Studies
  • Risk Assessment / methods*
  • Risk Assessment / standards
  • United States / epidemiology
  • Voluntary Health Agencies

Substances

  • Antihypertensive Agents
  • Hypolipidemic Agents
  • Platelet Aggregation Inhibitors
  • Aspirin