Similar Text Fragments Extraction for Identifying Common Wikipedia Communities

Abstract

Similar text fragments extraction from weakly formalized data is the task of natural language processing and intelligent data analysis and is used for solving the problem of automatic identification of connected knowledge fields. In order to search such common communities in Wikipedia, we propose to use as an additional stage a logical-algebraic model for similar collocations extraction. With Stanford Part-Of-Speech tagger and Stanford Universal Dependencies parser, we identify the grammatical characteristics of collocation words. With WordNet synsets, we choose their synonyms. Our dataset includes Wikipedia articles from different portals and projects. The experimental results show the frequencies of synonymous text fragments in Wikipedia articles that form common information spaces. The number of highly frequented synonymous collocations can obtain an indication of key common up-to-date Wikipedia communities.

More by Orken Mamyrbayev

• A Knowledge-Augmented Multi-Agent AI System for Context-Aware Legal Reasoning and Case Outcome PredictionPreprints.org · 2026
• YOLO12 МОДЕЛІН ГЕОРАДАР КЕСКІНДЕРІНЕ ҚОЛДАНУNEWS OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF KAZAKHSTAN · 2026
• Developing a Kazakh Audio–Visual Multimodal Speech Recognition Model Based on Hierarchical and Cross-Modal AttentionInformation · 2026
• Exploring the influence of firm digital transformation on sustainable competitive advantage through organizational agility with moderation of knowledge sharingDiscover Sustainability · 2026