Dissertation · eNTUKhPIIR Repository · January 1, 2020

Applying VSM to Identify the Criminal Meaning of Texts.

Nina Khairova, Anastasiia Kolesnyk, Orken J. Mamyrbayev, Світлана Валентинівна Петрасова

Abstract

Generally, to define the belonging of a text to a specific theme or domain, we can use approaches to text classification. However, the task becomes more complicated when there is no train corpus, in which the set of classes and the set of documents belonged to these classes are predetermined. We suggest using the semantic similarity of texts to determine their belonging to a specific domain. Our train corpus includes news articles containing criminal information. In order to define whether the theme of input documents is close to the theme of the train corpus, we propose to calculate the cosine similarity between documents of the corpus and the input document. We have empirically established the average value of the cosine similarity coefficient, in which the document can be attributed to the highly specialized documents containing criminal information.We evaluate our approach on the test corpus of articles from the news sites of Kharkiv. F-measure of the document classification with criminal information achieves 96 %.

Text and Document Classification TechnologiesTopic ModelingComputational and Text Analysis Methodsvector space modeltext classificationsemantic similarity

Applying VSM to Identify the Criminal Meaning of Texts.

Abstract

More by Orken Mamyrbayev