Talk · Conference on Empirical Methods in Natural Language Processing: System Demonstrations · January 1, 2026
SCOPE: Source Credibility and Outlet Profiling Engine
Ilyas Nagiyev, Miras Baisbay, Daniil Orel, Preslav Nakov
Abstract
We present SCOPE, a multi-agent system for profiling news media outlets with respect to bias, factuality, and credibility.Given an outlet URL, SCOPE coordinates specialized agents for article acquisition, content analysis, external evidence search, scoring, and report generation.The system follows an MBFC-style methodology while making intermediate evidence and agent outputs inspectable through a structured demonstration interface.On a benchmark of 200 media outlets, SCOPE outperforms LLM-only, article-only, search-only, and media-background-check baselines on most metrics, achieving the lowest bias and factuality MAE, perfect failed-fact-check detection, and the lowest factual error rate.These results suggest that decomposed, evidence-grounded agent workflows can support more transparent and reliable media profiling.Our code is available at https://github.com/ mbaisbay/SCOPE, and a live demonstration at https://scope-demo.streamlit. app/.Our video demonstration is available via the URL (clickable).
More by Daniil Orel
- Aligning Cultural Behaviors in Arabic Language Models via PreferencesarXiv · 2026
- Jais 2: A Family of Arabic-Centric Open Large Language ModelsarXiv · 2026
- Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute ScalingUnderline Science Inc. · 2026
- A Multi-View Media Profiling Suite: Resources, Evaluation, and AnalysisUnderline Science Inc. · 2026