-
Does ctranslate2 to have plans to support the recently released small, medium, and vision. I've tried running them with transformers (on Windows) and can't get past a Triton and compiler not found ki…
-
The Phi3-mini model has recently been added to Keras-NLP (https://github.com/keras-team/keras-nlp/pull/1597). However, more models such as Phi-small, Phi3-medium, and Phi3-vision have been released. I…
-
- [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)
- [Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)
- [Phi-3.5-vision-instruct](https://…
-
0.5.5 is out and includes support for InternVLM2, could we get a release with the new version, please? :)
-
step1
pretrain_projector_image_encoder.sh
step2
pretrain_projector_video_encoder.sh
step3
finetune_dual_encoder.sh
step4
eval/vcgbench/inference/run_ddp_inference.sh
step5
eval/vcgbench/gpt_e…
-
Using the following local Model pulled from HF here is my code:
```
var modelPath =
@"C:\models\Phi-3-vision-128k-instruct-onnx-cpu\cpu-int4-rtn-block-32-acc-level-4";
#p…
-
Thanks so much for your work on this!
How can I deploy this fine-tuned model (expose via API endpoint)? Can I use vLLM or a library like this: https://github.com/EricLBuehler/mistral.rs, which sup…
-
### Your current environment
vllm == 0.5.5.
### 🐛 Describe the bug
when we deploy the `microsoft/Phi-3.5-vision-instruct`,
it will randomly hit this issue.
```
[1;36m(VllmWorkerProcess p…
-
-
Using phi3 vision model:
A client sees this warning on their machine for text generation, still works:
```
Unable to create a device from version 1.614.0 of the DirectX 12 Agility SDK.
You can s…