Talk · IEEE International Conference on Smart Information Systems and Technologies · May 13, 2026
Document Segmentation in Legal Retrieval-Augmented Generation: An Empirical Study on Kazakh Legal Texts
Arailym Tleubayeva, Birganym Abilkhaiyr, Azamat Orazgali, Sabyr Berikuly, Aday Shomanov, Zhansaya Makhambetova
Abstract
Retrieval-Augmented Generation (RAG) has become a practical approach for legal question answering by grounding generated responses in authoritative documents. In legal domains, retrieval performance is closely linked to how documents are segmented into retrieval units. This paper analyzes the role of document chunking in Legal RAG for Kazakh legal texts, a low-resource and morphologically rich language. We introduce a structure-aware semantic chunking pipeline that preserves legal hierarchy while applying semantic refinement within structural boundaries to control chunk length and coherence. The approach is evaluated under sparse, dense, and hybrid retrieval configurations on a curated Kazakh legal corpus. Results show that structure-aware segmentation yields more stable early ranking behavior, reflected in higher nDCG@10 and MRR, while maintaining competitive recall. Additional experiments indicate that cross-encoder reranking does not provide consistent gains in this setting and significantly increases latency. The findings emphasize egmentation as an important architectural component in Legal RAG systems for low-resource legal contexts.
Related publications
- Structure-Aware Hybrid Legal RAG for Grounded Question Answering in KazakhInternational Conference on Advanced Machine Learning and Data Science · 2026 · Same author: Azamat Orazgali
- MPNet-Based Semantic Retrieval for Legal Evidence Selection: A Set Cover and Subset Selection PerspectiveEngineering Technology & Applied Science Research · 2026 · Shared topic: Topic Modeling
- A Knowledge-Augmented Multi-Agent AI System for Context-Aware Legal Reasoning and Case Outcome PredictionPreprints.org · 2026 · Shared topic: Topic Modeling
- Translate, Search, or Answer: Cost-Aware Cross-Lingual Retrieval for Kazakh Small Language ModelsBig Data and Cognitive Computing · 2026 · Shared topic: Topic Modeling
