kijai / ComfyUI-Florence2

Inference Microsoft Florence2 VLM
MIT License
300 stars 17 forks source link

What's the difference of the 4 models? #15

Open deepfree2023 opened 1 week ago

deepfree2023 commented 1 week ago

Hi, is there any guidance on how to choose among the 4 models?

WeirdScienceX commented 1 week ago

https://huggingface.co/microsoft/Florence-2-base

deepfree2023 commented 1 week ago

Thanks, I've read this before use.

But the actual performance of the models seems quite different from the description.

In my tests, the -ft ones seems always produce worse results on every task compared to non-ft ones.

kijai commented 1 week ago

I have heard that one possible reason for the -ft variants being worse, is that they are finetuned to do well in benchmarks. I really don't know how true that is though.