Purpose: To assess variability in corneal ulcer measurements between ophthalmologists and reduce clinician-dependent variability using semiautomated segmentation of the ulcer from photographs.
Methods: Three ophthalmologists measured 50 patients' eyes for epithelial defects (EDs) and the stromal infiltrate (SI) size using slit-lamp (SL) calipers. SL photographs were obtained. An algorithm was developed for semiautomatic segmenting of the ED and SI in the photographs. Semiautomatic segmentation was repeated 3 times by different users (2 ophthalmologists and 1 trainee). Clinically significant variability was assessed with intraclass correlation coefficients (ICCs) and the percentage of pairwise measurements differing by ≥0.5 mm. Semiautomatic segmentation measurements were compared with manual delineation of the image by a corneal specialist (gold standard) using Dice similarity coefficients.
Results: Ophthalmologists' reliability in measurements by SL calipers had an ICC from 0.84 to 0.88 between examiners. Measurements by semiautomatic segmentation had an ICC from 0.96 to 0.98. SL measures of ulcers by clinical versus semiautomatic segmentation measures differed by ≥0.5 mm in 24% to 38% versus 8% to 28% (ED height); 30% to 52% versus 12% to 34% (ED width); 26% to 38% versus 10% to 32% (SI height); and 38% to 58% versus 14% to 34% (SI width), respectively. Average Dice similarity coefficients between manual and repeated semiautomatic segmentation ranged from 0.83 to 0.86 for the ED and 0.78 to 0.83 for the SI.
Conclusions: Variability exists when measuring corneal ulcers, even among ophthalmologists. Photography and computerized methods for quantifying the ulcer size could reduce variability while remaining accurate and impact quantitative measurement endpoints.