Talk · Journal of Physics Conference Series · December 1, 2020
Pattern Matching-based scraping of news websites
Hamza Salem, Manuel Mazzara
Abstract
Abstract Web Scraping is the process of extracting content from human-readable websites in order to import it into local storage such as databases or CSV Files. The process of data extraction and its design is time-consuming requiring an analysis of the website, data representation of the objects comprising its structure (DOM), HTML tags, and the Cascading Style Sheets (CSS) classes. To support this process we aim at providing automation. In this paper, we propose a pattern mining technique to scrap news and blog websites by recognizing title and body based on a content structure pattern. This approach consists of three steps, i.e.: extracting news website structure, constructing a pattern of HTML content, and implementing the pattern as a set of rules in web scraping. Our approach is a simple, general, and straightforward way to extract articles that consist of the title, the body of any blogs, or news websites.
More by Manuel Mazzara
- Anchored Rank-Adversarial Fine-Tuning Pretrained Visual Place Recognition ModelsarXiv · 2026
- See the Future, Classify the Present: Stochastic Latent World Modeling for Hyperspectral ImagesarXiv · 2026
- Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on Quran Recitation DataLecture notes in computer science · 2026 · Citations: 1
- What Counts as a Mistake? Annotating Recitation Events in Quran Memorization TranscriptsarXiv · 2026