Crowdsourcing seizure detection: algorithm development and validation on human implanted device recordings

Brain. 2017 Jun 1;140(6):1680-1691. doi: 10.1093/brain/awx098.


There exist significant clinical and basic research needs for accurate, automated seizure detection algorithms. These algorithms have translational potential in responsive neurostimulation devices and in automatic parsing of continuous intracranial electroencephalography data. An important barrier to developing accurate, validated algorithms for seizure detection is limited access to high-quality, expertly annotated seizure data from prolonged recordings. To overcome this, we hosted a competition to crowdsource the development of seizure detection algorithms using intracranial electroencephalography from canines and humans with epilepsy. The top three performing algorithms from the contest were then validated on out-of-sample patient data including standard clinical data and continuous ambulatory human data obtained over several years using the implantable NeuroVista seizure advisory system. Two hundred teams of data scientists from all over the world participated in the competition. The top performing teams submitted highly accurate algorithms with consistent performance in the out-of-sample validation study. The performance of these seizure detection algorithms, achieved using freely available code and data, sets a new reproducible benchmark for personalized seizure detection. We have also shared a 'plug and play' pipeline to allow other researchers to easily use these algorithms on their own datasets. The success of this competition demonstrates how sharing code and high quality data results in the creation of powerful translational tools with significant potential to impact patient care.

Keywords: crowdsourcing; epilepsy; experimental models; intracranial EEG; seizure detection.

Publication types

  • Validation Study

MeSH terms

  • Adult
  • Algorithms*
  • Animals
  • Crowdsourcing / methods*
  • Crowdsourcing / standards
  • Disease Models, Animal
  • Electrocorticography / methods*
  • Electrocorticography / standards
  • Equipment Design / methods*
  • Equipment Design / standards
  • Humans
  • Prostheses and Implants
  • Reproducibility of Results
  • Seizures / diagnosis*