Talk · IEEE AITU: Digital Generation · April 3, 2024
Integration AI Techniques in Low-Resource Language: The Case of Kazakh Language
Kamshat Asmaganbetova, Ulanbek Auyeskhan, Nurzhanova Zarina, Serikbayev Alen, Malika Yeskazina
Abstract
Sentiment analysis is an extensively explored domain within natural language processing (NLP); nevertheless, a significant emphasis has been placed on languages possessing ample resources, such as English. This paper delves into the transformative capabilities of Optical Character Recognition (OCR), Natural Language Processing (NLP), and Speech Recognition, emphasizing their potential impact on low-resource languages, particularly focusing on Kazakh. OCR, a pivotal AI technique, extracts characters from images, revolutionizing the digitization of business records and streamlining mundane tasks. NLP, another powerful AI tool, analyzes and generates human-like text, while Speech Recognition converts spoken words into text. According to findings the OCR model demonstrated effectiveness, achieving an accuracy rate of 85% with losses ranging from 1.5 to 2, while TTS (text-to-speech) method mean opinion score (MOS) results with 95% confidence intervals. In addition, AI Meta research center assessed over 40,000 diverse translations, including Kazakh language directions using the human-translated benchmark, they integrated human evaluation with a unique toxicity benchmark across all 200 languages to ensure translation safety. Achieving a substantial 44% improvement over the prior state-of-the-art, the model by Meta AI establishes a crucial foundation for realizing a universal translation system. However, there remains ample room for exploration and refinement in the integration of these AI technologies, particularly in expanding the scope of evaluation metrics and addressing potential challenges in low-resource language settings.
Related publications
- Restoring Punctuation and Capitalization in Kazakh: A BERT-Based Approach for Text Normalization2025 · Citations: 3 · Shared topic: Natural Language Processing Techniques
- Fine-Tuning Methods and Dataset Structures for Multilingual Neural Machine Translation: A Kazakh–English–Russian Case Study in the IT DomainElectronics · 2025 · Citations: 4 · Shared topic: Natural Language Processing Techniques
- Low-resource Machine Translation for Code-switched Kazakh-Russian Language PairarXiv · 2025 · Citations: 1 · Shared topic: Natural Language Processing Techniques
- Transformer-Based Re-Ranking Model for Enhancing Contextual and Syntactic Translation in Low-Resource Neural Machine TranslationElectronics · 2025 · Citations: 33 · Shared topic: Natural Language Processing Techniques
