Article · IEEE Transactions on Geoscience and Remote Sensing · January 1, 2025

HPMF: Hypergraph-Guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images

Yan Li, Mingzhe Hao, Jiaman Ma, Amirkhan A. Temirbayev, Ying Li, Shijian Lu

Abstract

Few-shot object detection (FSOD) within remote sensing imagery has achieved great advancements in recent years. However, most existing methods are facing one key challenge while handling remote sensing images: many unlabeled instances in few-shot images are treated as background, which tends to degrade the generalization of the trained model severely. This paper presents HPMF, a Hypergraph-guided Prototype Mining Framework that addresses the challenge through joint optimization from three perspectives. The first is Hierarchical Reference Mining (HRM) which constructs a class-instance dual-driven prototype space that enables mining the unlabeled instances via cross-hierarchical similarity fusion. The second is a Robust Pseudo-box Estimator (RPE) that generates high-quality pseudo bounding boxes for the HRM-mined instances via adaptive density clustering and multi-statistic aggregation. The third is a Hypergraph-Guided Decoder (HGD) that introduces hypergraphs into the transformer decoder for group semantic modeling, enhancing high-order semantic association and similarity of instance features, thereby further improving the mining performance of the HRM module. Extensive experiments under various settings show that the proposed HPMF outperforms state-of-the-art methods consistently across multiple widely adopted remote-sensing FSOD benchmarks such as DIOR, NWPU-VHR10 v2, and HRRSD.

Advanced Neural Network ApplicationsRemote-Sensing Image ClassificationDomain Adaptation and Few-Shot Learningfew-shot object detectionremote sensing imageshypergraphs

HPMF: Hypergraph-Guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images

Abstract

More by Amirkhan Temirbayev