Talk · Findings of the Association for Computational Linguistics: EACL · January 1, 2026
Negative Sampling Techniques in Dense Retrieval: A Survey
Laurin Wischounig, Abdelrahman Abdallah, Adam Jatowt
Abstract
Information Retrieval (IR) is fundamental to many modern NLP applications.The rise of dense retrieval (DR), using neural networks to learn semantic vector representations, has significantly advanced IR performance.Central to training effective dense retrievers through contrastive learning is the selection of informative negative samples.Synthesizing 35 seminal papers, this survey provides a comprehensive and up-to-date overview of negative sampling techniques in dense IR.Our unique contribution is the focus on modern NLP applications and the inclusion of recent Large Language Model (LLM)-driven methods, an area absent in prior reviews.We propose a taxonomy that categorizes techniques including random, static/dynamically mined, and synthetic datasets.We then analyze these approaches with respect to trade-offs between effectiveness, computational cost, and implementation difficulty.The survey concludes by outlining current challenges and promising future directions for the use of LLM-generated synthetic data.
More by Abdelrahman Abdallah
- A Paired Printed-Handwritten Arabic Line Dataset for Handwriting Recognition and Cross-Modal RetrievalScientific Data · 2026
- A multilingual Arabic and English receipt dataset for text detection, recognition and information extractionZenodo · 2026
- UIBK-Embedding: Effective Text Retrieval by Unifying Dense and Late-Interaction RetrievalarXiv · 2026
- MemRevise: A Self-Revising Memory for Conversational SearcharXiv · 2026
