Article · The Visual Computer · March 1, 2026
Attention-enhanced CNN-LSTM framework for real-time video-based emotion recognition
Anandhavalli Muniasamy, Rizwan Abbas, Galiya Ybytayeva, Ashwag Alasmari, Nouf S. Aldahwan, Hend Khalid Alkahtani
Abstract
Emotion recognition from videos plays a vital role in enhancing interactive experiences across computer graphics and virtual reality (VR) applications. This paper presents EmotionViA, an attention-enhanced CNN-LSTM framework designed for real-time emotion recognition from facial expressions in videos. The framework integrates convolutional neural networks (CNNs) for spatial feature extraction and long short-term memory (LSTM) networks for capturing temporal dynamics, while an attention mechanism selectively emphasizes salient facial regions to improve classification accuracy. To further support research reproducibility, we introduce the EmotionViA dataset, encompassing diverse emotional expressions under varied conditions. Experimental results on EmotionViA, FER-2013, AffectNet, and RAF-DB demonstrate that our method surpasses state-of-the-art approaches in both accuracy and real-time performance. EmotionViA holds potential for immersive applications in education, entertainment, health care, and marketing. Our code is available at https://github.com/rizwanchouhan/emovid .
More by Galiya Ybytayeva
- Emotionally expressive facial animation driven by EmotionBERT embeddingsScientific Reports · 2026
- Physics-informed neural network framework for fast and accurate nanofluid heat-transfer prediction in microchannel heat sinksFrontiers in Physics · 2026 · Citations: 2
- Thermal mode modeling using neural network technologies and the finite element methodBulletin of Electrical Engineering and Informatics · 2026
- Precision healthcare in action: A robust MRI framework for breast cancer diagnosis with enhanced feature analysis and boundary refinementBiomedical Signal Processing and Control · 2026