Skip to content
Publications

Underline Science Inc. · March 6, 2026

Negative Sampling Techniques in Dense Retrieval: A Survey

Association for Computational Linguistics 2026, Abdelrahman Abdallah, Adam Jatowt, Laurin Wischounig

Abstract

Information Retrieval (IR) is fundamental to many modern NLP applications. The rise of dense retrieval (DR), using neural networks to learn semantic vector representations, has significantly advanced IR performance. Central to training effective dense retrievers through contrastive learning is the selection of informative negative samples. Synthesizing 35 seminal papers, this survey provides a comprehensive and up-to-date overview of negative sampling techniques in dense IR. Our unique contribution is the focus on modern NLP applications and the inclusion of recent Large Language Model (LLM)-driven methods, an area absent in prior reviews. We propose a taxonomy that categorizes techniques, including random, static/dynamically mined, and synthetic datasets. We then analyze these approaches with respect to trade-offs between effectiveness, computational cost, and implementation difficulty. The survey concludes by outlining current challenges and promising future directions for the use of LLM-generated synthetic data.

Information Retrieval and Search BehaviorTopic ModelingAdvanced Image and Video Retrieval Techniquesnegative samplingdense retrievalcontrastive learning

More by Abdelrahman Abdallah