Article · International Journal of Innovative Research and Scientific Studies · July 7, 2025

Document analysis via combined vectorization and machine learning approaches

Dinara Kaibassova, Bigul MUKHAMETZHANOVA, Dinara TOKSEIT, Aigul Kubegenova, Murat G. Kozhanov

Abstract

The purpose of this study is to develop an effective hybrid model for automatic document classification by combining statistical and semantic text vectorization techniques with machine learning algorithms. The methodology integrates Term Frequency–Inverse Document Frequency (TF-IDF) and Word2Vec embeddings with classifiers such as Support Vector Machine (SVM) and Random Forest. The proposed approach includes data preprocessing (tokenization, normalization, stop word removal, and lemmatization), feature extraction, model training, and evaluation using classification metrics such as accuracy, F1-score, Matthews Correlation Coefficient (MCC), and Cohen’s Kappa. Experimental results demonstrate that the Word2Vec + SVM model outperforms other configurations, achieving 90.2% accuracy and an F1-score of 82.52%, thus highlighting the advantage of incorporating semantic context into vector representation. The study concludes that hybrid methods combining TF-IDF and Word2Vec with robust classifiers improve both the precision and generalizability of document analysis models. Practical implications include potential applications in sentiment analysis, topic modeling, text classification for legal and healthcare domains, and multilingual contexts. This research provides a foundation for developing high-performance text analysis systems applicable to various real-world natural language processing tasks.

Text and Document Classification TechnologiesTopic ModelingComputational and Text Analysis Methodsautomatic document classificationTF-IDFWord2Vec embeddings

Document analysis via combined vectorization and machine learning approaches

Abstract

More by Dinara Kaibassova