halleewong / ScribblePrompt

[ECCV 2024] ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Medical Image
http://scribbleprompt.csail.mit.edu/
Apache License 2.0
155 stars 15 forks source link

Question: About Finetuning SAM #1

Closed Elsword016 closed 5 months ago

Elsword016 commented 9 months ago

Did you finetune SAM with points and bounding boxes or just with bounding boxes? Also, if only bounding boxes were used for fine-tuning, so does it work with clicks/points just out of the box?? Thanks

halleewong commented 9 months ago

Hi, we fine-tuned SAM on points, bounding boxes, and scribbles (represented as a series of points). So ScribblePrompt-SAM works out of the box with all three types of prompts (and combinations thereof) as well as mask inputs.

Elsword016 commented 9 months ago

Thank you for getting back to me. Will you be releasing any training script, I would love to fine-tune the model for my images

halleewong commented 6 months ago

Yes, we are planning to release training code! I am actively working on cleaning up the code so it can be released.