search

bfshi / scaling_on_scales

When do we not need larger vision models?
MIT License
277 stars 9 forks source link

Can you use this with SAM? #1

Closed jetjodh closed 4 months ago

jetjodh commented 4 months ago

Hi, congrats on the cool project. Have you tried using this with SAM models? Will it be able to give better segmentation results out of the box or will it require some fine-tuning with scales?

bfshi commented 4 months ago

Thank you! I think it can augment the features from SAM vision backbone without any tuning, but if we want to let the decoder to use the new features, we might need to tune the decoder.