Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion

By S. Amin, M. Alsulaiman, Muhammad Ghulam, M. Mekhtiche, M. S. Hossain. Future generations computer systems, 2019

464 citations recorded by the source corpus.

Abstract Electroencephalography (EEG) motor imagery (MI) signals have recently gained a lot of attention as these signals encode a person’s intent of performing an action. Researchers have used MI signals to help disabled persons, control devices such as wheelchairs and even for autonomous driving. Hence decoding these signals accurately is important for a Brain–Computer interface (BCI) system. But EEG decoding is a challenging task because of its complexity, dynamic nature and low signal to noise ratio. Convolution neural network (CNN) has shown that it can extract spatial and temporal features from EEG, but in order to learn the dynamic correlations present in MI signals, we need improved CNN models. CNN can extract good features with both shallow and deep models pointing to the fact that, at different levels relevant features can be extracted. Fusion of multiple CNN models has not been experimented for EEG data. In this work, we propose a multi-layer CNNs method for fusing CNNs with different characteristics and architectures to improve EEG MI classification accuracy. Our method utilizes different convolutional features to capture spatial and temporal features from raw EEG data. We demonstrate that our novel MCNN and CCNN fusion methods outperforms all the state-of-the-art machine learning and deep learning techniques for EEG classification. We have performed various experiments to evaluate the performance of the proposed CNN fusion method on public datasets. The proposed MCNN method achieves 75.7% and 95.4% on the BCI Competition IV-2a dataset and the High Gamma Dataset respectively. The proposed CCNN method based on autoencoder cross-encoding achieves more than 10% improvement for cross-subject EEG classification.

Subfields: Cognitive Neuroscience, Human-Computer Interaction, Signal Processing

View Paper: https://www.semanticscholar.org/paper/902d37e8602d8020d4d29d2c0bf1b140c130c46a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Signal Processing

Citations in the corpus

Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: a review (2021, methodology): “Some other researchers have attempted to develop more general, subject-independent, MI models that are trained and tested using separate subjects [94, 100, 108, 115, 123, 128].”
Physics-Informed Attention Temporal Convolutional Network for EEG-Based Motor Imagery Classification (2023, background): “Different DLarchitectureswasproposedforMIclassiﬁcationincluding convolutionalneuralnetwork(CNN)[8],[9],[10],[11],[12], [13],recurrentneuralnetwork(RNN)[14],[15],deepbelief network(DBN)[16],autoencoder(AE)[17],andhybridDL models[8],[18].”
Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI (2024, background): “…et al., 2020), acute stress detection (Sharma et al., 2022), sleep stage classification (Aboalayon et al., 2016), motor imagery recognition (Amin et al., 2019), abnormal identification (Roy et al., 2019), emotion analysis (Suhaimi et al., 2020), and auditory attention detection (Biesmans…”