---
title: "Iran University Fixes MedSAM's Fatal Flaw With a 1.6M-Parameter Click-to-Box Trick"
subtitle: "A 1.6M-parameter Box Predictor module turns a single click into a bounding box, dramatically improving MedSAM segmentation across CT, MRI, and ultrasound"
url: "https://alphasignal.ai/news/iran-university-fixes-medsam-s-fatal-flaw-with-a-1-6m-parameter-click-to-box"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-03T00:00:00.000Z"
updated: "2026-06-11T02:44:58.381Z"
type: "Paper"
topics:
  - "Image"
  - "Benchmarks"
subtopics:
  - "Segmentation"
  - "Vision Language"
upvotes: 878
source_url: "https://arxiv.org/abs/2606.04705"
comments: 0
truncated: true
---

# Iran University Fixes MedSAM's Fatal Flaw With a 1.6M-Parameter Click-to-Box Trick

> A 1.6M-parameter Box Predictor module turns a single click into a bounding box, dramatically improving MedSAM segmentation across CT, MRI, and ultrasound

Getting an AI to accurately outline a tumor or organ in a medical scan is harder than it looks. The images are low-contrast, the structures are irregular, and the models are notoriously sensitive to how you tell them where to look. A new paper from Iran University of Science and Technology tackles one of the most persistent pain points in this space: the fragility of point-based prompting in [MedSAM](https://arxiv.org/abs/2304.02643), the leading foundation model for medical image segmentation.

## Why a single click isn't enough

MedSAM is a fine-tuned version of Meta's Segment Anything Model (SAM), trained on over 200,000 medical masks spanning 11 imaging modalities. While MedSAM improves over the original SAM by training on diverse medical imaging data, the heterogeneity across imaging modalities, anatomical regions, and acquisition protocols means that further domain-specific fine-tuning is often necessary to achieve optimal performance on particular clinical tasks.

The deeper problem is prompt design. SAM-based models are highly sensitive to the quality of input prompts, with this issue becoming particularly severe in medical imaging where regions of interest are often small, irregular, or poorly contrasted. Point prompts , where a user clicks somewhere inside the target region , are the most natural interaction, but they give the model almost no spatial context. A single dot in the middle of a brain MRI slice could mean a tumor, a ventricle, or healthy tissue. The model has to guess the extent of what you want.

There's also a subtler technical trap. MedSAM was fine-tuned with bounding box prompts as the primary prompt type, so its prompt encoder and mask decoder have learned to expect spatial inputs in this form. When you give it a point instead, you're not just providing less information , you're giving it the wrong kind of information entirely. The ablation results are stark: when MedSAM is used without any retraining, relying solely on a point prompt results in very poor performance across all datasets, with Dice scores ranging from 1.64 to 10.53.

## One click, one box

The proposed fix is elegant in its simplicity. The team introduces a **Box Predictor** module: a small MLP (multi-layer perceptron , a basic feedforward neural network) that takes a single user click and automatically estimates a bounding box around the target structure. That predicted box is then fed into MedSAM's prompt encoder, restoring the geometric context the model was trained to expect.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation (arXiv)](https://arxiv.org/abs/2606.04705)
- [MedSAM-BoxPredictor GitHub Repository](https://github.com/Amirhosseinmovahedi/MedSAM-BoxPredictor)
- [Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation](https://arxiv.org/abs/2304.12620)
- [Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions](https://arxiv.org/pdf/2401.03495)