Identifying epilepsy surgery referral candidates with natural language processing in an Australian context

Abstract

Objective: Epilepsy surgery is known to be underutilized. Machine learning-natural language processing (ML-NLP) may be able to assist with identifying patients suitable for referral for epilepsy surgery evaluation.

Methods: Data were collected from two tertiary hospitals for patients seen in neurology outpatients for whom the diagnosis of "epilepsy" was mentioned. Individual case note review was undertaken to characterize the nature of the diagnoses discussed in these notes, and whether those with epilepsy fulfilled prespecified criteria for epilepsy surgery workup (namely focal drug refractory epilepsy without contraindications). ML-NLP algorithms were then developed using fivefold cross-validation on the first free-text clinic note for each patient to identify these criteria.

Results: There were 457 notes included in the study, of which 250 patients had epilepsy. There were 37 (14.8%) individuals who fulfilled the prespecified criteria for epilepsy surgery referral without described contraindications, 32 (12.8%) of whom were not referred for epilepsy surgical evaluation in the given clinic visit. In the prediction of suitability for epilepsy surgery workup using the prespecified criteria, the tested models performed similarly. For example, the random forest model returned an area under the receiver operator characteristic curve of 0.97 (95% confidence interval 0.93-1.0) for this task, sensitivity of 1.0, and specificity of 0.93.

Significance: This study has shown that there are patients in tertiary hospitals in South Australia who fulfill prespecified criteria for epilepsy surgery evaluation who may not have been referred for such evaluation. ML-NLP may assist with the identification of patients suitable for such referral.

Plain language summary: Epilepsy surgery is a beneficial treatment for selected individuals with drug-resistant epilepsy. However, it is vastly underutilized. One reason for this underutilization is a lack of prompt referral of possible epilepsy surgery candidates to comprehensive epilepsy centers. Natural language processing, coupled with machine learning, may be able to identify possible epilepsy surgery candidates through the analysis of unstructured clinic notes. This study, conducted in two tertiary hospitals in South Australia, demonstrated that there are individuals who fulfill criteria for epilepsy surgery evaluation referral but have not yet been referred. Machine learning-natural language processing demonstrates promising results in assisting with the identification of such suitable candidates in Australia.

Keywords: data mining; natural language processing; neurosurgery; seizures; text analysis.