Article · Data · August 5, 2026
The ArchiveGene Corpus: A Synthetic Multi-Layer Benchmark for Genealogical Information Extraction from Uzbek Historical Archival Texts
Dauletov Adilbek Yusupbayevich, Noila Matyakubova, Sevara M. Allabergenova, Nargisa Ashirmatova, Miyassar Tillayeva, Sevara Yoqubova
Abstract
Automatic extraction of genealogical information from historical archival-genealogical documents in Uzbek is an understudied problem for low-resource languages. Multi-layer NLP benchmarks are not sufficient to automatically identify individuals, family relationships, dates, place names, and archival identifiers in such texts. Also, the same people are mentioned in various forms: full name, pronoun (18.8%), initial, surname-name order, indirect expression (9.4%), and title. Existing NER and relation extraction corpora are mainly focused on high-resource languages or general domain texts and do not sufficiently cover the FAMILY_ROLE signals, historical spelling variants, and fond–opis–delos identifiers specific to Uzbek archival-genealogical texts. Proposed resource: We present the ArchiveGene Corpus, a controlled, fully synthetic, and reproducible five-layer resource consisting of 1000 Uzbek archival-genealogical-style documents, divided into 700 training, 150 validation, and 150 test documents. The corpus contains 8366 named entities, 10,625 person mentions, 2000 coreference chains, and 1000 genealogical relation triples. The dataset was generated using a deterministic template-based pipeline and a lexicon of Uzbek names, and is fully reproducible. Inter-annotator agreement values were 0.847 for NER, 0.793 for coreference, and 0.821 for RE, according to Cohen’s κ. Comparative results are presented with four baseline models (rule-based, BiLSTM-CRF, mBERT, and XLM-RoBERTa). The dataset is openly hosted on the Zenodo platform under the CC BY 4.0 license; concept DOI: 10.5281/zenodo.20670360, v1.1.1 version DOI: 10.5281/zenodo. 21429998. Scientific significance: To the best of our knowledge, ArchiveGene is among the first openly released, controlled synthetic resources for Uzbek that integrates named-entity recognition, person-mention detection, coreference resolution, genealogical relation extraction, and final tuple generation within a single annotation framework. The baseline analysis provides three main conclusions: (1) on the clean synthetic test set, the transformer models already reach 100.00 Micro-F1 for NER and 100.00 Macro-F1 for coreference-aware relation extraction, so coreference aggregation adds little on synthetic data (+2.25 for mBERT and +0.04 for XLM-RoBERTa) but its contribution is expected to grow on real archival text; (2) the rule-based and heuristic baselines lag far behind (Macro-F1 50.28 and 70.73) and fail entirely on spouse_of, showing the limits of lexical rules; and (3) a zero-shot evaluation on a real-document pilot reduces NER Micro-F1 from 100.00 to 22.17, indicating that the synthetic corpus is trivially learnable and that real-archival validation is essential.
More by Noila Matyakubova
- A Multitask XLM-R-Based Hybrid Approach for Named Entity Recognition, Coreference Resolution, and Genealogical Relation Extraction from Uzbek Historical DocumentsMachine Learning and Knowledge Extraction · 2026
- UzArchMeta-IR: A Metadata-Aware Retrieval Test Collection for Uzbek Digital ArchivesZenodo · 2026
- UzAlign v1.1.1: A Morphologically Annotated Uzbek–English Parallel Corpus with Model-Assisted Word AlignmentData · 2026
- UzPoetMeta Gold v1.1: Open Annotations for Metaphor Detection in Classical and Modern Uzbek PoetryZenodo · 2026
