Talk · IEEE International Conference on Smart Information Systems and Technologies · May 14, 2025
Development and Evaluation of a Small Kazakh Language Corpus to Improve the Efficiency of Multilingual NLP Systems in Low-Resource Environments
Arailym Tleubayeva, Sultan Aubakirov, Aisultan Tabuldin, Adai Shomanov
Abstract
This study tackles NLP challenges in low-resource settings by developing the Small Kazakh Language Corpus—a high-quality, annotated collection of Kazakh texts sourced from news, scientific publications, and Wikipedia. The corpus was used to fine-tune two models for masked language modeling: the multilingual XLM-RoBERTa-base and the Kazakh-specific nur-dev/roberta-kaz-large. Fine-tuning notably improved XLM-RoBERTa-base's accuracy from 48.84% to 68.85% and F1-score from 41.96% to 68.62%, while nur-dev/roberta-kaz-large showed more modest gains. These findings demonstrate the critical role of language-specific resources in enhancing multilingual NLP systems and provide a solid foundation for further research in applications such as machine translation, sentiment analysis, and question answering.
More by Adai Shomanov
- EEG-XR: A Cross-Reality EEG Dataset for Neuroergonomic Analysis Across Desktop, Virtual, and Mixed RealityMendeley Data · 2026
- Next-generation BCI spellers: a comparative study of ERP responses and fatigue in mixed, virtual, and desktop realitiesVirtual Reality · 2025 · Citations: 2
- Enhancing Question Answering for Low-Resource Languages: The Case of Kazakh LanguageIEEE/ACM International Conference on Utility and Cloud Computing · 2025 · Citations: 1
- A Systematic Evaluation of Large Language Models and Retrieval-Augmented Generation for the Task of Kazakh Question AnsweringInformation · 2025 · Citations: 18