Skip to content
DSML.KZ
Publications

Article · Bulletin of Electrical Engineering and Informatics · December 1, 2025

The extraction of a brief summary from scientific documents using machine learning methods

Gulden Murzabekova, Galiya Mukhamedrakhimova, Zhazira Taszhurekova, Yerbol Yerbayev, Жанагул Доумчариева, Valentina E. Makhatova

Yerbol Yerbayev
Open via DOIPDF

Abstract

This study proposes a machine learning-based approach for automatic summarization of scientific documents using a fine-tuned DistilBART model a lightweight and efficient version of the bidirectional and auto-regressive transformers (BART) architecture. The model was trained on a large corpus of 12,540 scientific articles (2015–2023) collected from the arXiv repository, enabling it to effectively capture domain-specific terminology and structural patterns. The proposed pipeline integrates advanced text preprocessing techniques, including tokenization, stopword removal, and stemming, to enhance the quality of semantic representation. Experimental evaluation demonstrates that the fine-tuned DistilBART achieves high summarization performance, with ROUGE-2=0.472 and ROUGE-L=0.602, outperforming baseline transformer-based models. Unlike conventional approaches, the method shows strong applicability beyond academic research, including automated indexing of technical documentation, metadata extraction in digital libraries, and real-time text processing in embedded natural language processing (NLP) systems. The results highlight the potential of transformer-based summarization to accelerate scientific knowledge discovery and improve the efficiency of information retrieval across various domains.

Advanced Text Analysis TechniquesTopic ModelingText Readability and Simplificationautomatic summarizationscientific documentsfine-tuning

More by Yerbol Yerbayev