Exploring spatial-frequency-sequential relationships for motor imagery classification with recurrent neural network

BMC Bioinformatics. 2018 Sep 29;19(1):344. doi: 10.1186/s12859-018-2365-1.

Abstract

Background: Conventional methods of motor imagery brain computer interfaces (MI-BCIs) suffer from the limited number of samples and simplified features, so as to produce poor performances with spatial-frequency features and shallow classifiers.

Methods: Alternatively, this paper applies a deep recurrent neural network (RNN) with a sliding window cropping strategy (SWCS) to signal classification of MI-BCIs. The spatial-frequency features are first extracted by the filter bank common spatial pattern (FB-CSP) algorithm, and such features are cropped by the SWCS into time slices. By extracting spatial-frequency-sequential relationships, the cropped time slices are then fed into RNN for classification. In order to overcome the memory distractions, the commonly used gated recurrent unit (GRU) and long-short term memory (LSTM) unit are applied to the RNN architecture, and experimental results are used to determine which unit is more suitable for processing EEG signals.

Results: Experimental results on common BCI benchmark datasets show that the spatial-frequency-sequential relationships outperform all other competing spatial-frequency methods. In particular, the proposed GRU-RNN architecture achieves the lowest misclassification rates on all BCI benchmark datasets.

Conclusion: By introducing spatial-frequency-sequential relationships with cropping time slice samples, the proposed method gives a novel way to construct and model high accuracy and robustness MI-BCIs based on limited trials of EEG signals.

Keywords: Brain computer interface; Deep recurrent neural networks; EEG signals classification; Spatial-frequency-sequential relationships.

MeSH terms

  • Algorithms
  • Brain-Computer Interfaces*
  • Databases, Genetic
  • Datasets as Topic
  • Electroencephalography / classification*
  • Electroencephalography / methods*
  • Humans
  • Imagination / physiology*
  • Neural Networks, Computer*
  • Signal Processing, Computer-Assisted*
  • Support Vector Machine