Global uncertainty in the diagnosis of neurological complications of SARS-CoV-2 infection by both neurologists and non-neurologists: An international inter-observer variability study

Abstract

Introduction: Uniform case definitions are required to ensure harmonised reporting of neurological syndromes associated with SARS-CoV-2. Moreover, it is unclear how clinicians perceive the relative importance of SARS-CoV-2 in neurological syndromes, which risks under- or over-reporting.

Methods: We invited clinicians through global networks, including the World Federation of Neurology, to assess ten anonymised vignettes of SARS-CoV-2 neurological syndromes. Using standardised case definitions, clinicians assigned a diagnosis and ranked association with SARS-CoV-2. We compared diagnostic accuracy and assigned association ranks between different settings and specialties and calculated inter-rater agreement for case definitions as "poor" (κ ≤ 0.4), "moderate" or "good" (κ > 0.6).

Results: 1265 diagnoses were assigned by 146 participants from 45 countries on six continents. The highest correct proportion were cerebral venous sinus thrombosis (CVST, 95.8%), Guillain-Barré syndrome (GBS, 92.4%) and headache (91.6%) and the lowest encephalitis (72.8%), psychosis (53.8%) and encephalopathy (43.2%). Diagnostic accuracy was similar between neurologists and non-neurologists (median score 8 vs. 7/10, p = 0.1). Good inter-rater agreement was observed for five diagnoses: cranial neuropathy, headache, myelitis, CVST, and GBS and poor agreement for encephalopathy. In 13% of vignettes, clinicians incorrectly assigned lowest association ranks, regardless of setting and specialty.

Conclusion: The case definitions can help with reporting of neurological complications of SARS-CoV-2, also in settings with few neurologists. However, encephalopathy, encephalitis, and psychosis were often misdiagnosed, and clinicians underestimated the association with SARS-CoV-2. Future work should refine the case definitions and provide training if global reporting of neurological syndromes associated with SARS-CoV-2 is to be robust.

Keywords: COVID-19; Diagnosis; Inter-rater agreement; Neurology; SARS-CoV-2.