search

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime
MIT License
500 stars 126 forks source link

Support for Vision models like Phi3 Vision and Microsoft's Florence 2? #645

Closed BrainSlugs83 closed 4 months ago

BrainSlugs83 commented 4 months ago

Just what the title says. Will there be support for Phi 3 Vision and Florence 2?

baijumeswani commented 4 months ago

@BrainSlugs83 We already have support for Phi3 Vision. Please see the tutorial here: https://onnxruntime.ai/docs/genai/tutorials/phi3-v.html

We have added Florence to our roadmap, but not sure if it will be prioritized for the next release.

natke commented 4 months ago

@BrainSlugs83 We have a Discussion open for Florence-2 V. https://github.com/microsoft/onnxruntime-genai/discussions/categories/model-support

Please try Phi-3 vision and let us know how you go.