Validation of a Computational Phenotype to Identify Acute Brain Dysfunction in Pediatric Sepsis

Abstract

Objectives: To validate a computational phenotype that identifies acute brain dysfunction (ABD) based on clinician concern for neurologic or behavioral changes in pediatric sepsis.

Design: Retrospective observational study.

Setting: Single academic children's hospital.

Patients: Four thousand two hundred eighty-nine index sepsis episodes.

Interventions: None.

Measurements and main results: An existing computational phenotype of ABD was optimized to include routinely collected variables indicative of clinician concern for acute neurologic or behavioral change (completion of CT or MRI, electroencephalogram, or new antipsychotic administration). First, the computational phenotype was compared with an ABD reference standard established from chart review of 527 random sepsis episodes to determine criterion validity. Next, the computational phenotype was compared with a separate validation cohort of 3,762 index sepsis episodes to determine content and construct validity. Criterion validity for the final phenotype had sensitivity 83% (95% CI, 76-89%), specificity 93% (90-95%), positive predictive value 84% (77-89%), and negative predictive value 93% (90-96%). In the validation cohort, the computational phenotype identified ABD in 35% (95% CI 33-36%). Content validity was demonstrated as those with the ABD computational phenotype were more likely to have characteristics of neurologic dysfunction and severe illness than those without the ABD phenotype, including nonreactive pupils (15% vs 1%; p < 0.001), Glasgow Coma Scale less than 5 (44% vs 12%; p < 0.001), greater than or equal to two nonneurologic organ dysfunctions (50% vs 25%; p < 0.001), and need for intensive care (81% vs 65%; p < 0.001). Construct validity was demonstrated by higher odds for mortality (odds ratio [OR], 6.9; 95% CI, 5.3-9.1) and discharge to rehabilitation (OR, 11.4; 95% CI 7.4-17.5) in patients with, versus without, the ABD computational phenotype.

Conclusions: A computational phenotype of ABD indicative of clinician concern for new neurologic or behavioral change offers a valid retrospective measure to identify episodes of sepsis that involved ABD. This computational phenotype provides a feasible and efficient way to study risk factors for and outcomes from ABD using routinely collected clinical data.