Article · Scientific Reports · October 28, 2024
Compact convolutional transformer for subject-independent motor imagery EEG-based BCIs
Aigerim Keutayeva, Nail Fakhrutdinov, Berdakh Abibullaev
Abstract
Motor imagery electroencephalography (EEG) analysis is crucial for the development of effective brain-computer interfaces (BCIs), yet it presents considerable challenges due to the complexity of the data and inter-subject variability. This paper introduces EEGCCT, an application of compact convolutional transformers designed specifically to improve the analysis of motor imagery tasks in EEG. Unlike traditional approaches, EEGCCT model significantly enhances generalization from limited data, effectively addressing a common limitation in EEG datasets. We validate and test our models using the open-source BCI Competition IV datasets 2a and 2b, employing a Leave-One-Subject-Out (LOSO) strategy to ensure subject-independent performance. Our findings demonstrate that EEGCCT not only outperforms conventional models like EEGNet in standard evaluations but also achieves better performance compared to other advanced models such as Conformer, Hybrid s-CViT, and Hybrid t-CViT, while utilizing fewer parameters and achieving an accuracy of 70.12%. Additionally, the paper presents a comprehensive ablation study that includes targeted data augmentation, hyperparameter optimization, and architectural improvements.
Related publications
- FSSM-ResNet: Hair-Aware Skin Lesion Segmentation with Embedded Fuzzy Structural SuppressionIEEE International Conference on Fuzzy Systems · 2026 · Same author: Наиль Фахрутдинов
- ZhadigerAI: Software-as-a-Service AI Platform for Kazakh and EnglishLecture notes in computer science · 2026 · Same author: Наиль Фахрутдинов
- Patch and Model Size Characterization for On-Device Efficient-ViTs on Small Datasets Using 12 Quantitative MetricsIEEE Access · 2025 · Citations: 5 · Same author: Наиль Фахрутдинов
- Multi-Scale EEG Feature Extraction with Attention Mechanism for Seizure DetectionJournal of KIISE · 2026 · Shared topic: EEG and Brain-Computer Interfaces
