1 parent f26abc9 commit db54cdfCopy full SHA for db54cdf
1 file changed
models/backbone.py
@@ -1,15 +1,3 @@
1
-"""
2
-Vision backbone: BioMedCLIP ViT-B/16 fine-tuned on medical literature.
3
-
4
-Microsoft's BiomedCLIP (https://huggingface.co/microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224)
5
-is pre-trained on 15M biomedical image-text pairs from PubMed — giving it domain
6
-knowledge that vanilla ImageNet ViTs lack.
7
8
-We extract only the vision encoder and expose its patch embeddings for:
9
- 1. The classification head (see classifier.py)
10
- 2. GradCAM attention rollout (see explainability/gradcam.py)
11
12
13
from __future__ import annotations
14
15
import torch
0 commit comments