Talk · International Scientific-Technical Conference on Actual Problems of Electronic Instrument Engineering · November 14, 2025
Detecting Allusions in the Karakalpak Language Using mBERT
Davlatyor B. Mengliev, Raima Kh. Shirinova, Худайберганов Темур Рустамович, Shaxnoza Abdukayumova, Xilola YUNUSOVA, Djumaniyazova Intizor Davlatnazar qizi
Abstract
This paper investigates the problem of allusion detection in Karakalpak texts using neural network technologies such as mBERT. Although this problem has been studied well enough for such world languages as English, Russian, Chinese, etc., there are almost no studies for low-resource languages. The proposed solution includes not only the preparation of a language model, but also the formation of a corpus of literary texts from more than 5,000 sentences. To prevent overfitting, an early stopping mechanism was used, which allowed us to identify the most optimal model indicators. Empirical results on two different test sets show that the model works reliably on literary texts, but demonstrates a noticeable drop in performance when working with texts of various topics. In addition, a comparative analysis of existing solutions is carried out in order to emphasize the relevance of the work done. Moreover, the authors note that they plan to expand the dataset with a variety of literary topics, as well as informal genre texts, in order to further actualize the developed solution in applied.
More by Temur Rustamovich Khudayberganov
- Industry Practitioners Developing or Implementing AI Platforms for Healthcare and Life SciencesAdvances in computational intelligence and robotics book series · 2026
- Hybrid DES and Continuous Models for Cyber-Physical Ubiquitous EnvironmentsAdvances in computational intelligence and robotics book series · 2026
- Robustness of Spectral-Geometric Invariants Under Realistic 3D Acquisition Distortions: A Critical Review, Taxonomy, and Comparative Evaluation ProtocolInternational Siberian workshops and tutorials on electron devices and materials · 2026
- Methods for Geometrically Robust Encoding and Synchronization of Audio-Video Metadata in Parametric 3D Surfaces (NURBS/Mesh): Taxonomy, Threat Models, Design Requirements, and Benchmark EvidenceInternational Siberian workshops and tutorials on electron devices and materials · 2026
