Talk · Conference on Empirical Methods in Natural Language Processing · January 1, 2025
ComplexTempQA: A 100m Dataset for Complex Temporal Question Answering
Raphael Gruber, Abdelrahman Abdallah, Michael Färber, Adam Jatowt
Abstract
We introduce COMPLEXTEMPQA, 1 a largescale dataset consisting of over 100 million question-answer pairs designed to tackle the challenges in temporal question answering.COMPLEXTEMPQA significantly surpasses existing benchmarks in scale and scope.Utilizing Wikipedia and Wikidata, the dataset covers questions spanning over two decades and offers an unmatched scale.We introduce a new taxonomy that categorizes questions as attributes, comparisons, and counting questions, revolving around events, entities, and time periods, respectively.A standout feature of COMPLEXTEMPQA is the high complexity of its questions, which demand reasoning capabilities for answering such as across-time comparison, temporal aggregation, and multihop reasoning involving temporal event ordering and entity recognition.Additionally, each question is accompanied by detailed metadata, including specific time scopes, allowing for comprehensive evaluation of temporal reasoning abilities of large language models.
More by Abdelrahman Abdallah
- A Paired Printed-Handwritten Arabic Line Dataset for Handwriting Recognition and Cross-Modal RetrievalScientific Data · 2026
- A multilingual Arabic and English receipt dataset for text detection, recognition and information extractionZenodo · 2026
- UIBK-Embedding: Effective Text Retrieval by Unifying Dense and Late-Interaction RetrievalarXiv · 2026
- MemRevise: A Self-Revising Memory for Conversational SearcharXiv · 2026
