search

microsoft / BiomedParse

BiomedParse: A Foundation Model for Joint Segmentation, Detection, and Recognition of Biomedical Objects Across Nine Modalities
https://microsoft.github.io/BiomedParse/
Apache License 2.0
158 stars 10 forks source link

Question on finetuning #20

Open hpichlerbio opened 3 days ago

hpichlerbio commented 3 days ago

Thanks for the great work!

I am really interested in finetuning this on my own data, but I am not quite sure, if it is possible. Can I also finetune the model on instance segmentation data? Semantic segmentation is not possible in my case. If not, do you have any recommendations on foundation models capable of doing instance segmentation without having to add an adapter to the model?

Thank you in advance!

theodore-zhao commented 3 days ago

Thanks for the feedback! The model currently output semantic segmentation only. I will add a postprocessing script on the output to turn it into instance segmentation. Then you can finetune on semantic mask and post process to instance outputs.

hpichlerbio commented 2 days ago

Thanks for the feedback! The model currently output semantic segmentation only. I will add a postprocessing script on the output to turn it into instance segmentation. Then you can finetune on semantic mask and post process to instance outputs.

Thanks, that would be amazing!