SMASH 2026 · Paper #2 · Result card

Gated Knowledge-Guided Prototype Transfer for Zero-Support Medical Vision Language Model

Sumaiya Fazal, Rizwan Qureshi, Laleh Behjat, Samira Ebrahimi Kahou · FAST-NUCES · MGH/Harvard · University of Calgary · Mila · Read the paper

Ungated transfer made a missing grade worse in 46–50% of support draws. The gate cut that to 16% and added +2.37 points of missing-class recall.
classes No DR (3), Mild (1), Moderate (1), Severe (0), Proliferative (0)zero-support Severe, Proliferativeβ 1.0k 3temperature automodality gap 1.0separability 1.0gap shrink / grade 0.5support draws 50data synthetic ordinal embedding world
Negative-transfer rate
46–50% → 16%
share of 50 support draws where missing-class recall fell; ungated (VLM / ontology) → gated
Missing-class recall (gated)
+2.37 pts
95% CI [+1.72, +2.95] vs SS-Text+ (73.4% → 75.8%)
Supported-class recall (gated)
+0.97 pts
ΔSCR (paper: −1.20); Δtop-1 +1.12, ΔACA +1.53, ΔH +1.56
Evidence gate
0.51 / 0.22
Severe 0.514 · Proliferative 0.215 (paper: 0.582 severe, 0.214 proliferative)

From the abstract

We introduce gated Knowledge-Guided Prototype Transfer (KGPT), a pre-repulsion module that transfers supported-class visual residuals to missing classes using VLM similarity and an ontology-based clinical distance. A validation-free evidence gate scales transfer based on semantic relevance and residual agreement, thereby limiting unsupported extrapolation.

Evidence

How often does borrowing knowledge make the missing classes worse?
How often does borrowing knowledge make the missing classes worse?
Each dot is one random support draw (same support for all methods). Orange dots: missing-class recall fell relative to SS-Text+ (negative transfer). Black bar = mean. Dotted line = −5 points (severe negative transfer).
Is the gate just a smaller step size?
Is the gate just a smaller step size?
Same hybrid neighbours, transfer strength β varied. Ungated uses the full β; gated uses β·g with g from the evidence (agreement × relevance). Dotted line = your β. Extension, not in the paper.
Gate inspector: why each zero-support class gets the update it gets
Gate inspector: why each zero-support class gets the update it gets
Agreement a = how much the selected residuals point the same way; relevance q = √(VLM margin × 1/ontology distance). Orange ticks: the paper's MESSIDOR gates.
Who pays, who gains? Recall per class
Who pays, who gains? Recall per class
Mean recall over support draws. Shaded = zero-support classes. Paper (MESSIDOR), severe / proliferative recall: gated 46.53 / 73.71 vs KGPT-VLM 37.47 / 68.00.

Paper vs. your run

MetricPaperYour run
SS-Text+ Top-1 / ACA / MCR / SCR / H57.45 / 54.64 / 54.90 / 54.46 / 52.8772.9 / 62.7 / 73.4 / 55.5 / 63.0absolute levels depend on the synthetic world
Ungated NTR (VLM / Ont), severe NTR46% / 48%; severe 38% / 34%50% / 46%; severe 16% / 14%NTR = share of draws with ΔMCR < 0; severe = ΔMCR < −5
Ungated ΔMCR (VLM / Ont)−2.16 [−4.73, 0.32] / −2.43 [−4.68, −0.21]-0.28 [-1.54, +1.05] / +0.32 [-0.93, +1.61]
Gated ΔMCR / ΔACA / ΔH+5.23 [3.84, 6.69] / +1.37 [0.78, 1.99] / +1.83 [1.06, 2.64]+2.37 [+1.72, +2.95] / +1.53 / +1.56
Gated ΔSCR / ΔTop-1−1.20 [−1.52, −0.88] / −0.45 [−0.71, −0.19]+0.97 / +1.12the price of transfer
Gated NTR; draws improved / unchanged2%; 36 improved, 13 unchanged of 5016%; 42 improved, 0 unchanged of 50
Mean gate (severe / proliferative)0.582±0.010 / 0.214±0.0030.514±0.019 / 0.215±0.008paper relevances 0.381 / 0.102 imply agreement a ≈ 0.94–0.95

Try next

Read this before sharing