Evidence-Grounded LLM Summarization for Actionable Student Feedback Analysis

Abstract

Analyzing large-scale student feedback is critical for higher education quality assurance, yet manual analysis is inefficient and subjective. This paper proposes an integrated framework that unifies supervised classification, unsupervised clustering, and retrieval-augmented generation (RAG) to produce evidence-grounded and actionable insights. Ensemble-based supervised models perform thematic classification, while multi-encoder embedding fusion enables unsupervised discovery of coherent feedback clusters. A multi-stage RAG module integrates category predictions and cluster structure to retrieve representative evidence and generate transparent summaries with citation traceability. The framework is evaluated on student feedback collected from a Central Asian university and two public benchmarks, EduRABSA and Coursera course reviews, covering seven thematic categories. The supervised ensemble achieves 83.0% accuracy and 0.829 Macro-F1 on the primary dataset, while unsupervised clustering attains a silhouette score of 0.271 under the best fusion strategy. Independent evaluation on external benchmarks yields ensemble accuracy of 81.1% on EduRABSA and 49.8% on Coursera, confirming the framework’s adaptability across diverse educational contexts. By leveraging supervised labels and unsupervised structure, the proposed framework enables evidence-grounded, category-aware LLM-based summaries that faithfully reflect the diversity and distribution of student feedback and support actionable educational decision-making.

Related publications

• Multi-Task Deep Learning for Damage Classification, Structured Caption Generation, and Image Synthesis of RC Beam-Column Joint FailuresNazarbayev University Repository · 2026 · Same author: Yerassyl Saparbekov
• QazNLP: A Morphology-Aware Kazakh NLP Toolkit with Structured Decoding for POS and NERLecture notes in mechanical engineering · 2026 · Shared topic: Sentiment Analysis and Opinion Mining
• Enhanced Sentiment Analysis of E-Commerce Product Reviews Using Luong Attention-Based Bi-LSTMInformation · 2026 · Citations: 2 · Shared topic: Sentiment Analysis and Opinion Mining
• LLM-Assisted Weak Supervision for Low-Resource Kazakh Sequence Labeling: Synthetic Annotation and CRF-Refined NER/POS ModelsApplied Sciences · 2026 · Citations: 3 · Shared topic: Sentiment Analysis and Opinion Mining