-
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior …
-
In [phi-3 vision directml](https://huggingface.co/microsoft/Phi-3-vision-128k-instruct-onnx-directml) using either python or c# certain questions just return ``
For example "Why is the sky blue?" r…
-
Does ctranslate2 to have plans to support the recently released small, medium, and vision. I've tried running them with transformers (on Windows) and can't get past a Triton and compiler not found ki…
-
Since Phi-3 mini did so well on the leaderboard, it would be interesting to see where the new small and medium models land.
With Phi-3 vision, it also seems like we're starting to have a pretty hea…
-
Please let us know what model architectures you would like to be added!
**Up to date todo list below. Please feel free to contribute any model, a PR without device mapping, ISQ, etc. will still be …
-
### Is your feature request related to a problem? Please describe.
Now that we have the Phi-3 SLM flagship family (including vision) from Microsoft, it would make more than sense to officially and fu…
-
### System Info
Hello TensorRT-LLM team! 👋 I'm facing an issue where the inference output does not contain the expected "Singapore" text. Below are the details of my setup and steps to reproduce the …
-
### **Background:**
TT-Buda, developed by Tenstorrent, is a growing collection of model demos showcasing the capabilities of AI models running on Tenstorrent hardware. These demonstrations cover a wi…
-
### What happened?
I was trying to use Fireworks https://fireworks.ai/models/fireworks/phi-3-vision-128k-instruct model with litellm but the `litellm.completion_cost` fails because the model is missi…
-
The Phi3 vision model is excellent and does a great job in extracting text. I am using the CPU version via C# DirectML package.
1. What is the max image filesize in kb that can be sent to the mode…