A dual-branch deep learning framework for emotion recognition from EEG signals

Abstract

Mental health monitoring through emotion recognition plays an important role in early intervention and personalized healthcare systems. Traditional EEG-based emotion recognition approaches have encountered significant limitations, including heavy reliance on manual feature engineering, poor generalization across datasets, and computational complexity that restricts real-world deployment. This study introduces a novel hybrid dual-branch deep learning architecture that integrates temporal and spectral feature extraction for robust EEG-based emotion recognition, while minimizing preprocessing requirements. The proposed framework integrates a Long Short-Term Memory (LSTM) network to capture temporal dependencies directly from raw EEG signals, while concurrently leveraging Convolutional Neural Networks (CNNs) to extract spatial features from Mel-Frequency Cepstral Coefficients (MFCC) representations. This architecture further incorporates innovative cross-modality enhancement mechanisms, such as inverse MFCC computation and LSTM-to-MFCC projection, which facilitate bidirectional feature learning between temporal and spectral domains. Subsequently, feature fusion is achieved through element-wise multiplication and concatenation, and the integrated representations are classified using an Artificial Neural Network (ANN). The evaluation has been conducted on three benchmark datasets: Brainwave EEG, WESAD, and SWELL, achieving remarkable performance with accuracies of 96.49%, 99.99%, and 99.99%, respectively. The model has attained perfect precision, recall, and F1-scores on the WESAD and SWELL datasets, setting new state-of-the-art standards. Comparative analysis has demonstrated the method's superiority over existing machine learning and deep learning techniques, while preserving computational efficiency that supports real-time applications. These results have confirmed the framework's strong potential for practical use in mental health monitoring and affective computing. The source code of this work is available at: https://github.com/DebamSahaCS/Dual-Branch-DL-Framework.

More by Dmitry Kaplun

• Codewithsayanjib/slm-systematic-review: v1.1Zenodo · 2026
• Microscopy Image Dataset of pulmonary vessels for Quantitative assessment of fibrosisScientific Data · 2026
• Microscopy Image Dataset of pulmonary vessels for Deep Learning-Based Quantitative assessment of fibrosisFigshare · 2026
• MA2MU-Net++: A Mahalanobis distance and Ackley function based multi-modal U-Net++ model for breast nuclei segmentation in histopathology imagesBiomedical Signal Processing and Control · 2026