A Multi-Level Hybrid Architecture for Structured Sentiment Analysis

Abstract

This paper presents a hybrid architecture for automatic sentiment analysis of Kazakh-language political discourse. The Kazakh language is characterized by an agglutinative structure, a complex word-formation system, and the limited availability of digital resources, which significantly complicates the application of standard neural network approaches. To account for these characteristics, a multi-level system was developed that combines morphological and syntactic analysis rules, ontological relationships between political concepts, and multilingual representations of the XLM-R model, used in zero-shot mode. A corpus of 12,000 sentences was annotated for sentiment polarity and used for training and evaluation, while Universal Dependencies annotation was applied for morpho-syntactic analysis. Rule-based components compensate for errors related to affixation variability, modality, and directive constructions. An ontology comprising over 300 domain concepts ensures the correct interpretation of set expressions, terms, and political actors. Experimental results show that the proposed hybrid architecture outperforms both neural network baseline models and purely rule-based solutions, achieving Macro-F1 = 0.81. Ablation revealed that the contribution of modules is unevenly distributed: the ontology provides +0.04 to Macro-F1, the UD syntax +0.08, and the rule-based module +0.11. The developed system forms an interpretable and robust assessment of tonality, emotions, and discursive strategies in political discourse, and also creates a basis for further expansion of the corpus, additional training of models, and the application of hybrid methods to other tasks of analyzing low-resource languages.

More by Zhanar Lamasheva

• A multilingual heterogeneous knowledge graph framework for curriculum–vacancy–MOOC alignment: edge-weight regression with heterogeneous graph transformers for educational recommendationFrontiers in Artificial Intelligence · 2026
• FROM AN ANNOTATED CORPUS TO AN ONTOLOGY: A FORMAL MODEL OF MULTI-LEVEL SEMANTIC ANNOTATION OF FAKE NEWS IN THE KAZAKH–RUSSIAN MEDIA SPACE (KazFakeCorpus / KazFakeOnto)Russian Digital Libraries Journal · 2026
• An Abstention-Aware, Calibrated Risk-Gated Controller for Canary Deployment under Low ObservabilityEngineering Technology & Applied Science Research · 2026
• A Multi-Model Approach to Academic Performance Prediction Using Student–Semester Educational DataArtificial Intelligence and Applications · 2026