Skip to content
Publications

Talk · E3S Web of Conferences · January 1, 2025

Graph-based neural networks with neural ODEs for robust speech processing in environmental and human-centric systems

Сакен Мамбетов, Ainur Ormanbekova, Serik Joldasbayev, Laura Duissembayeva, Bulgyn Mailykhanova

Abstract

This paper introduces H-STGNN-ODE-DA, a novel model for voice sentiment analysis that combines multi-scale acoustic feature extraction, hierarchical graph neural networks (GNNs), Neural Ordinary Differential Equations (Neural ODEs), and domain-adversarial adaptation. Designed to enhance accuracy and robustness under real-world conditions, the model was evaluated on IEMOCAP, MELD, and EmoDB datasets, outperforming state-of-the-art approaches such as LSTM, CNN, GCN, GAT, DANN, and SPECTRA. Notably, it achieved a 4.0% improvement over GAT on MELD. Neural ODEs enabled effective modeling of continuous emotional transitions, while domain-adversarial adaptation ensured robustness to domain shifts. Ablation studies confirmed the critical role of each component in achieving high performance. The model demonstrated strong cross-domain transferability, maintaining high accuracy across diverse recording conditions. These results position H- STGNN-ODE-DA as a robust and versatile solution for real-world applications in speech processing, including virtual assistants, social media analysis, and customer service systems.

Emotion and Mood RecognitionSpeech Recognition and SynthesisSentiment Analysis and Opinion Mininggraph neural networksneural ordinary differential equationshierarchical graph neural networks

More by Serik Joldasbayev