SimRelUz: Similarity and Relatedness scores as a Semantic Evaluation dataset for Uzbek language

Abstract

Semantic relatedness between words is one of the core concepts in natural language processing, thus making semantic evaluation an important task. In this paper, we present a semantic model evaluation dataset: SimRelUz - a collection of similarity and relatedness scores of word pairs for the low-resource Uzbek language. The dataset consists of more than a thousand pairs of words carefully selected based on their morphological features, occurrence frequency, semantic relation, as well as annotated by eleven native Uzbek speakers from different age groups and gender. We also paid attention to the problem of dealing with rare words and out-of-vocabulary words to thoroughly evaluate the robustness of semantic models.

More by Ulugbek Salaev

• A SINGLE-LAYER FEEDFORWARD NEURAL NETWORK MODEL FOR MORPHOLOGICAL STEMMING OF UZBEK WORDSIlmiy axborotnoma/Scientific Journal of Samarkand University · 2026
• Comparative Analysis of Neural Sequence Labeling Approaches for Uzbek Morphological ModelingInternational Siberian workshops and tutorials on electron devices and materials · 2026
• Neural Sequence Models for Uzbek Morphological StemmingInternational Scientific-Technical Conference on Actual Problems of Electronic Instrument Engineering · 2025 · Citations: 7
• A Morphology-Aware Neural Network Model for Uzbek Text ClassificationInternational Scientific-Technical Conference on Actual Problems of Electronic Instrument Engineering · 2025 · Citations: 1