Skip to content
Publications

Article · Journal of Intelligent & Fuzzy Systems · April 2, 2024

Smooth it up!: Extractive summary coherence enhancement

Dilyara Akhmetova, Iskander Akhmetov, Alexandr Pak, Alexander F. Gelbukh

Abstract

The paper focuses on the importance of coherence and preserving the breadth of content in summaries generated by the extractive text summarization method. The study utilized the dataset containing 16,772 pairs of extractive and corresponding abstractive summaries of scientific papers specifically tailored to increase text coherence. We smoothed the extractive summaries with a Large Language Model (LLM) fine-tuning approach and evaluated our results by applying the coefficient of variation approach. The statistical significance of the results was assessed using the Kolmogorov-Smirnov test and Z-test. We observed an increase in coherence in the predicted texts, highlighting the effectiveness of our proposed methods.

Advanced Text Analysis TechniquesTopic ModelingText Readability and Simplificationextractive summarizationtext coherencelarge language models

More by Iskander Akhmetov