Feature-level fusion approaches based on multimodal EEG data for depression recognition

By Hanshu Cai, Zhidiao Qu, Zhe Li, Yi Zhang, Xiping Hu, Bin Hu. Information Fusion, 2020

312 citations recorded by the source corpus.

Abstract This study aimed to construct a novel multimodal model by fusing different electroencephalogram (EEG) data sources, which were under neutral, negative and positive audio stimulation, to discriminate between depressed patients and normal controls. The EEG data of different modalities were fused using a feature-level fusion technique to construct a depression recognition model. The EEG signals of 86 depressed patients and 92 normal controls were recorded simultaneously while receiving different audio stimuli. Then, from the EEG signals of each modality, linear and nonlinear features were extracted and selected to obtain features of each modality. In addition, a linear combination technique was used to fuse the EEG features of different modalities to build a global feature vector and find several powerful features. Furthermore, genetic algorithms were used to perform feature weighting to improve the overall performance of the recognition framework. The classification accuracy of each classifier, namely the k-nearest neighbor (KNN), decision tree (DT), and support vector machine (SVM), was compared, and the results were encouraging. The highest classification accuracy of 86.98% was obtained by the KNN classifier in the fusion of positive and negative audio stimuli, demonstrating that the fusion modality could achieve higher depression recognition accuracy rate compared with the individual modality schemes. This study may provide an additional tool for identifying depression patients.

Subfields: Cardiology and Cardiovascular Medicine, Cognitive Neuroscience

View Paper: https://www.semanticscholar.org/paper/674dc5424a1146384fb077641c71197017c8870b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

1. Bin Hu
2. Prayag Tiwari
3. Yazhou Zhang
4. Meihong Yang
5. Xiang Li
6. Zhigang Zhao
7. Pekka Marttinen
8. Neeraj Kumar

Citations in the corpus

• A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances (2022, background): “The applications of visual emotion recognition include course teaching [431], smarter decision aid [432], HCI [433], dynamic quality adaption to the players in games [434–436], depression recognition [437] and for helping medical rehabilitation children affected by the autism spectrum condition [438”
• EEG Based Emotion Recognition: A Tutorial and Review (2022, background): “In the ield of neurology, identiied emotions in response to speciic stimuli and the corresponding neural activities can be analyzed for diagnosing some afective disorders, such as PTSD (post straumatic stress disorder) [7] and depression [8, 9].”