Predictive performance of the competing risk model in screening for preeclampsia

Abstract

Background: The established method of screening for preeclampsia is to identify risk factors from maternal demographic characteristics and medical history; in the presence of such factors the patient is classified as high risk and in their absence as low risk. However, the performance of such an approach is poor. We developed a competing risks model, which allows combination of maternal factors (age, weight, height, race, parity, personal and family history of preeclampsia, chronic hypertension, diabetes mellitus, systemic lupus erythematosus or antiphospholipid syndrome, method of conception and interpregnancy interval), with biomarkers to estimate the individual patient-specific risks of preeclampsia requiring delivery before any specified gestation. The performance of this approach is by far superior to that of the risk scoring systems.

Objective: The objective of the study was to examine the predictive performance of the competing risks model in screening for preeclampsia by a combination of maternal factors, mean arterial pressure, uterine artery pulsatility index, and serum placental growth factor, referred to as the triple test, in a training data set for the development of the model and 2 validation studies.

Study design: The data for this study were derived from 3 previously reported prospective, nonintervention, multicenter screening studies for preeclampsia in singleton pregnancies at 11⁺⁰ to 13⁺⁶ weeks' gestation. In all 3 studies, there was recording of maternal factors and biomarkers and ascertainment of outcome by appropriately trained personnel. The first study of 35,948 women, which was carried out between February 2010 and July 2014, was used to develop the competing risks model for prediction of preeclampsia and is therefore considered to be the training set. The 2 validation studies were comprised of 8775 and 16,451 women, respectively, and they were carried out between February and September 2015 and between April and December 2016, respectively. Patient-specific risks of delivery with preeclampsia at <34, <37, and <41⁺³ weeks' gestation were calculated using the competing risks model and the performance of screening for preeclampsia by maternal factors alone and the triple test in each of the 3 data sets was assessed. We examined the predictive performance of the model by first, the ability of the model to discriminate between the preeclampsia and no-preeclampsia groups using the area under the receiver operating characteristic curve and the detection rate at fixed screen-positive rate of 10%, and second, calibration by measurements of calibration slope and calibration in the large.

Results: The detection rate at the screen-positive rate of 10% of early-preeclampsia, preterm-preeclampsia, and all-preeclampsia was about 90%, 75%, and 50%, respectively, and the results were consistent between the training and 2 validation data sets. The area under the receiver operating characteristic curve was >0.95, >0.90, and >0.80, respectively, demonstrating a very high discrimination between affected and unaffected pregnancies. Similarly, the calibration slopes were very close to 1.0, demonstrating a good agreement between the predicted risks and observed incidence of preeclampsia. In the prediction of early-preeclampsia and preterm-preeclampsia, the observed incidence in the training set and 1 of the validation data sets was consistent with the predicted one. In the other validation data set, which was specifically designed for evaluation of the model, the incidence was higher than predicted, presumably because of better ascertainment of outcome. The incidence of all-preeclampsia was lower than predicted in all 3 data sets because at term many pregnancies deliver for reasons other than preeclampsia, and therefore, pregnancies considered to be at high risk for preeclampsia that deliver for other reasons before they develop preeclampsia can be wrongly considered to be false positives.

Conclusion: The competing risks model provides an effective and reproducible method for first-trimester prediction of early preeclampsia and preterm preeclampsia as long as the various components of screening are carried out by appropriately trained and audited practitioners. Early prediction of preterm preeclampsia is beneficial because treatment of the high-risk group with aspirin is highly effective in the prevention of the disease.

Keywords: Combined Multimarker Screening and Randomized Patient Treatment with Aspirin for Evidence-Based Preeclampsia Prevention trial; aspirin; calibration; competing risks model; discrimination; first-trimester screening; mean arterial blood pressure; performance of screening; placental growth factor; preeclampsia; survival model; uterine artery Doppler.