Skip to content
Publications

Talk · AIP conference proceedings · January 1, 2024

Unveiling the variance of Uzbek language: A rule-based algorithm for dialect recognition

Davlatyor B. Mengliev, Владимир Борисович Барахнин, Shohrux Madirimov, Bahodir B. Ibragimov, Mukhriddin O. Eshkulov, Bobur Rashidovich Saidov

Abstract

The study presents an algorithm for recognizing dialects of Uzbek language, which is one of the low-resource languages. The authors did research about related works in this field, and included results of brief comparative analysis in second sub-section of the manuscript. Moreover, during the study a rule-based algorithm for dialect detection was developed, which uses 100 000 words dictionaries for each dialect in the analysis process. This approach differs from existing solutions by its transparency in the analysis process of the words, which allows tracking each step of the algorithm. For more optimized performance of the algorithm, the authors divided the corpus of each dialect into dictionaries, each dialect has 28 dictionaries and thus 140 dictionaries were generated. Testing of the algorithm showed its high accuracy in identifying dialect words and processing mixed dialect entries.

Natural Language Processing TechniquesSpeech Recognition and SynthesisSpeech and dialogue systemsUzbek languagedialect identificationrule-based algorithm

More by Mukhriddin Eshkulov