Closed AshD closed 3 months ago
Looking for onnx version of microsoft/Phi-3-vision-128k-instruct Onnx files don't seem to be on Hugging Face.
We intend to publish the onnx variant of the Phi3-Vision model in the next couple of days. We also intend to release the 0.3.0-rc2 onnxruntime-genai package in the same time frame that can run this model.
Also, Does the onnxruntime-genai support multiple GPUs on the same PC?
As of now, the onnxruntime-genai can only execute models on a single GPU. Executing models on multiple GPUs is a feature we plan to add in the future.
Thanks @baijumeswani
Do you have the paper published about the architecture and details of Phi3-Vision model?
The Phi-3 Technical Report should have details on the model architecture.
The onnx version of the vision model has been published. Please refer to this tutorial on getting started: https://onnxruntime.ai/docs/genai/tutorials/phi3-v.html.
Closing this issue now. Please open another issue if you have further questions.
Looking for onnx version of microsoft/Phi-3-vision-128k-instruct Onnx files don't seem to be on Hugging Face.
Also, Does the onnxruntime-genai support multiple GPUs on the same PC?
Thanks, Ash