Data in Brief · April 5, 2023
Dataset of Karakalpak language stop words
Khabibulla A. Madatov, Shukurla Bekchanov, Jernej Vičič
Abstract
The dataset presented in this paper aims to address the challenge of automatic extraction of stop words in Natural Language Processing (NLP) for the low-resource Karakalpak language spoken by approximately two million people in Uzbekistan. To accomplish this, we have created a corpus of 23 Karakalpak language school textbooks, which we have named the Karakalpak Language School Corpus (KAASC). Using the KAASC corpus, we have constructed lists of stop words using three methods based on Term Frequency-Inverse Document Frequency (TF-IDF): unigram, bigram, and collocation methods, respectively. The resulting lists of stop words, along with a list of URLs used to construct the corpus, make up the described dataset in this paper.
More by Jernej Vičič
- AI-generated text detection for Slavic languagesZenodo · 2026
- Dataset of Uzbek base words: extraction and data analysis based on the school corpusSocial Sciences & Humanities Open · 2026 · Citations: 2
- Dataset of Uzbek base wordsRepository of the University of Primorsk · 2026
- Uzbek 65 million web corpus lemmatized Word2Vec modelZenodo · 2026