Talk · International Conference on Future Networks and Distributed Systems · December 11, 2024
Restoring Punctuation in Uzbek Texts Using LLM's Fine Tuning Approaches
Muhammadjon Musaev, Mannon Ochilov, Malika Abdullaeva, Rashid Nasimov
Abstract
This study draws attention to the use of transformation-based ad-hoc tuning models for detecting and recovering punctuation marks in Uzbek language texts. The research was conducted to accurately predict punctuation marks including commas, full stops, exclamation marks and question marks using Bert and XML-Roberta architectures. The research is to develop a specialized database on key aspects of Uzbek punctuation, which helps the existence of focused research in this area. It has yielded good results in tests, confirming the potential of transformer models for punctuation recovery in low-resource languages, including Uzbek. The paper focuses on the development of tokenizers specialized exclusively for Uzbek. Methods for recovering punctuation marks in Uzbek language and improving model accuracy in case of class label mismatch were also discussed for future research. The study indicated that the mean F1 score in determining whether a word after 4 punctuation marks and punctuation marks is uppercase or lowercase in Uzbek language was 87.9%.
More by Mannon Ochilov
- PadSink-Track: A Calibrated Framework for Padding-Sink-Preserving, Alignment-Tracked Selective Cross-Attention Key–Value Cache Access in CPU-Based Whisper Speech RecognitionTechnologies · 2026
- A Cache-Aware Compression Framework: Deriving the Compression Target and Stopping Rule for Transformers on CPU-Class HardwareAI · 2026
- The Achievement of Speech Technologies in Enhancing the Rehabilitation of Hearing-Impaired PatientLecture notes in networks and systems · 2026
- Performance Evaluation of Parallel Programming Models for K-means Clustering on Parallel Computing SystemsInternational Siberian workshops and tutorials on electron devices and materials · 2026
