Article · Computers · October 1, 2026
Toward an Adaptive Speech-to-Summary Pipeline for Turkic Languages: Language-Specific ASR, Conditional Morphology-Aware Correction, Pivot Translation, and Summarization
Ualsher Tukeyev, Assem Shormakova, Aidana Karibayeva, Diana Rakhimova, Balzhan Abduali, Oleg Myssov
Abstract
Speech-to-Summary cascade performance for low-resource, morphologically rich languages depends on interactions among language, recognition errors, and translation direction. This study develops an adaptive Speech-to-Summary pipeline for six Turkic languages—Azerbaijani, Kazakh, Kyrgyz, Turkish, Turkmen, and Uzbek—integrating ASR, conditional morphology-aware post-processing (MAPP), MT, pivot routing, and summarization. Whisper-family models lead external benchmarks for Turkish, Kazakh, and Azerbaijani; MMS for Kyrgyz, Uzbek, and Turkmen. The Uzbek benchmark-best model proves unreliable on real recordings, requiring a different deployed model. Pause-based segmentation reduces ASR errors for Kazakh, Azerbaijani, Uzbek, and Kyrgyz but is not universally beneficial. MAPP shows no consistent improvement on strong real-ASR outputs; only 3.6% of real Uzbek substitution errors are reachable by the correction rules, supporting conditional rather than mandatory correction. MT evaluation across 22 FLORES-200 directions reveals direction-dependent performance and sensitivity to script compatibility. Pivot selection is language-dependent: direct-Kazakh routing performs better for Kazakh, Turkmen, and Turkish, whereas Azerbaijani benefits from an English pivot. The results support replacing a fixed cascade with a configurable architecture selecting ASR, segmentation, correction, MT, and pivot routing by language, error patterns, and deployment constraints. Routing decisions are currently made offline based on empirical evidence; automatic routing is left for future work.
More by Oleg Myssov
- Speech-to-Speech Translation from Kazakh into Turkic Languages: Pretrained Speech Encoders, Turkic Speech Units, and Lessons from Negative ResultsComputers · 2026
- RESTORING PUNCTUATION IN AUTOMATIC SPEECH RECOGNITION FOR KAZAKH LANGUAGEEKTU Journal of Information and Communication Sciences · 2026
- From Speech to Readable Text: Automatic Punctuation in ASR Systems of the Kazakh LanguageCommunications in computer and information science · 2026
- Adapting Large-Scale Foundation Models for Turkic Speech-to-Speech Translation: Fine-Tuned Cascade and Direct ApproachesBig Data and Cognitive Computing · 2026 · Citations: 1