Back to Projects
Explainable AI & Medical Imaging

BRAIN (Breast Retrieval-Augmented Intelligence Network)

Designed an explainable AI system for breast cancer diagnosis utilizing a Swin Transformer Base (Swin-B) architecture.

Technical Innovation

Designed a custom Swin-B Transformer model equipped with a Dual-Head Loss system to analyze mammography data. Key technical features include:

  • Dual-Head Loss: Framework combining Cross-Entropy and Triplet Loss with Batch Hard Mining to optimize feature extraction.
  • RAG-based Verification: Engineered a Retrieval-Augmented Verification module using Facebook's FAISS library to cross-check predictions against a 24,576-image knowledge base (IMSMD).
  • Lesion Visualization: Integrated Grad-CAM++ and Attention Rollout to provide visual heatmaps of pathological features like microcalcifications and spiculated margins.

Results & Performance

  • Achieved 100% classification accuracy and an AUC-ROC of 1.00 on a held-out test set of 4,916 multi-institutional mammograms.
  • Delivered a clinical decision support system that surfaces transparent visualizations of lesion boundaries.
  • Mitigated AI hallucinations by verifying predictions against historical cases using the FAISS similarity search.