Article · IEEE Access · January 1, 2025
Improving BI-RADS Mammographic Classification With Self-Supervised Vision Transformers and Cascade Learning
Abdelrahman Abdallah, Mahmoud SalahEldin Kasem, Ibrahim Abdelhalim, Norah Saleh Alghamdi, Ayman S El-Baz
Abstract
Accurate and early breast cancer detection is critical for improving patient outcomes. In this study, we propose PatchCascade-ViT, a novel self-supervised Vision Transformer (ViT) framework for automated BI-RADS classification of mammographic images. Unlike conventional deep learning approaches that rely heavily on annotated datasets, PatchCascade-ViT leverages Self Patch-level Supervision (SPS) to learn meaningful mammographic representations from unlabeled data, significantly enhancing classification performance. Our framework operates through a two-stage cascade classification process. In the first stage, the model differentiates non-cancerous from potentially cancerous mammograms using SelfPatch, an innovative self-supervised learning task that enhances patch-level feature learning by enforcing consistency among spatially correlated patches. The second stage refines the classification by distinguishing Scattered Fibroglandular from Heterogeneously and Extremely Dense breast tissue categories, enabling more precise breast cancer risk assessment. To validate the effectiveness of PatchCascade-ViT, we conducted extensive evaluations on a dataset of 4,368 mammograms across three BI-RADS classes. Our method achieved a system sensitivity of 85.01% and an F1-score of 84.90%, outperforming existing deep learning-based approaches. By integrating self-supervised learning with a cascade vision transformer architecture, PatchCascade-ViT reduces reliance on annotated datasets while maintaining high classification accuracy. These findings demonstrate its potential for enhancing breast cancer screening, aiding radiologists in early detection, and improving clinical decision-making.
More by Abdelrahman Abdallah
- A Paired Printed-Handwritten Arabic Line Dataset for Handwriting Recognition and Cross-Modal RetrievalScientific Data · 2026
- A multilingual Arabic and English receipt dataset for text detection, recognition and information extractionZenodo · 2026
- UIBK-Embedding: Effective Text Retrieval by Unifying Dense and Late-Interaction RetrievalarXiv · 2026
- MemRevise: A Self-Revising Memory for Conversational SearcharXiv · 2026
