Article · Trudy Universiteta · September 30, 2023
Development of Data Analysis Method for the Preprocessing of Natural Language Texts
Murat G. Kozhanov, Dinara Kaibassova, A. Tau, Gulzhan KAZKEN
Abstract
A method based on Data Mining and natural language text preprocessing approaches to form a document corpus is proposed. The aim of the study is to develop a method of Data Analysis for the preprocessing of natural language texts of professional standards and structural elements of educational content. To achieve this goal, a study of the structural elements of educational and professional content, the corpus of documents and the database of competencies was made. The content of the topic planning of syllabuses has considered as educational content. Professional content was presented as a requirement in the professional standards of labor functions and competencies. It also describes a Data Mining method and an approach to the preprocessing of natural language texts. The result was a corpus of documents extracted from large volumes of semi-structured documents.
More by Dinara Kaibassova
- A Reproducible Hybrid AI Framework for Early Soil Nutrient Screening from Sentinel-2 Remote Sensing DataTechnologies · 2026
- A DATASET OF KAZAKH HANDWRITTEN CHARACTERSVestnik Torajgyrov universiteta. Seriâ: fizika, matematika i kompʹûternye nauki · 2026
- Evaluation Protocol for Morphology Tolerant Predictive Text in Kazakh Using N Gram ModelsIEEE International Conference on Smart Information Systems and Technologies · 2026
- INTERPRETING CLINICAL RESEARCH FOR DISEASE DIAGNOSIS: A MACHINE LEARNING PERSPECTIVEBulletin of Toraighyrov University Physics & Mathematics series · 2026