search

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.
MIT License
8.48k stars 1.33k forks source link

fine-tune SAM with point prompts #318

Open Once88 opened 1 year ago

Once88 commented 1 year ago

@NielsRogge @grahamannett @FrancescoSaverioZuppichini

Hello. I tried your notebook for fine tune SAM on the breast dataset. https://github.com/NielsRogge/Transformers-Tutorials/blob/master/SAM/Fine_tune_SAM_(segment_anything)_on_a_custom_dataset.ipynb

But, how to use point prompts to fine-tune or predict the model?

antopost commented 7 months ago

Did you found a solution? Other than inputting the same number of points for each sample or training with a batch size of 1 I can't find how to get it to work.