Article · International Journal of Innovative Research and Scientific Studies · October 10, 2025
Methodology for creating datasets of parallel sentences in low-resource languages by using AI
Balzhan Abduali, Marek Miłosz, Ualsher Tukeyev, Aidana Karibayeva
Abstract
This study addresses the crucial problem of data scarcity for low-resource languages, with a particular focus on a methodology for creating parallel corpora in two low-resource languages. The lack of large-scale, high-quality bilingual datasets significantly hinders the development of neural machine translation systems for such languages. This study proposes and validates a methodology for creating such datasets. The methodology involves selecting an AI system to generate a parallel corpus based on criteria of accessibility (free access), translation quality, and efficiency, based on a test dataset of 1000 sentences. Subsequently, a substantial parallel corpus of Kyrgyz-Kazakh was created using the selected AI system. However, manual error analysis revealed that approximately 0.5% of the translations contained inaccuracies, indicating the need for further post-editing and model refinement. This study contributes to the development of resources for low-resource language pairs and provides practical guidance on the effective creation of parallel corpora using modern AI systems.
More by Aidana Karibayeva
- Speech-to-Speech Translation from Kazakh into Turkic Languages: Pretrained Speech Encoders, Turkic Speech Units, and Lessons from Negative ResultsComputers · 2026
- Toward an Adaptive Speech-to-Summary Pipeline for Turkic Languages: Language-Specific ASR, Conditional Morphology-Aware Correction, Pivot Translation, and SummarizationComputers · 2026
- RESTORING PUNCTUATION IN AUTOMATIC SPEECH RECOGNITION FOR KAZAKH LANGUAGEEKTU Journal of Information and Communication Sciences · 2026
- From Speech to Readable Text: Automatic Punctuation in ASR Systems of the Kazakh LanguageCommunications in computer and information science · 2026
