-
mlx-community/Phi-3.5-vision-instruct-4bit fails to load in the current MLX build of LM Studio.
````
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: Lo…
-
**LocalAI version:**
2.30.0
**Environment, CPU architecture, OS, and Version:**
6.11.0-9-generic # 9-Ubuntu SMP PREEMPT_DYNAMIC Mon Oct 14 13:19:59 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux…
-
**The bug**
The 'quick spot check to verify we can rebuild complex multi-token unicode symbols' check in the `TransformersTokenizer` constructor is failing for Phi-3-vision-128k-instruct.
This i…
-
### Your current environment
vllm == 0.5.5.
### 🐛 Describe the bug
when we deploy the `microsoft/Phi-3.5-vision-instruct`,
it will randomly hit this issue.
```
[1;36m(VllmWorkerProcess p…
-
Hi,
I am trying to provision a serverless endpoint using azapi_resource for the azureml://registries/azureml/models/Phi-3.5-vision-instruct model in eastus2 but i am getting an error that "The reques…
-
Hello.
It seems that the latest Ollama with IPEX-LLM version `(0.3.6)` is a little old nowadays.
It doesn't have proper support for new and popular models like:
1) `Phi 3.5`
2) `Qwen 2.5`
3…
-
I am running the [phi3 vision directml](https://huggingface.co/microsoft/Phi-3-vision-128k-instruct-onnx-directml/tree/main/directml-int4-rtn-block-32) tutorial [code](https://onnxruntime.ai/docs/gena…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
### #
- [ ] I have searched the existing issues
### Is your feature request related to a problem? Please describe it
I can't send images with Phi-3.5-3.8B-vision-instruct
Image is grayed out and I…
-
- [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct)
- [Phi-3.5-MoE-instruct](https://huggingface.co/microsoft/Phi-3.5-MoE-instruct)
- [Phi-3.5-vision-instruct](https://…