-
I already downloaded phi3 instruct gguf from: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf/resolve/main/Phi-3-mini-4k-instruct-q4.gguf
and placed it at: ~/models/
jawad@desktoper:~…
-
### What is the issue?
I downloaded model 3 moths ago and it worked fine, but now it doesn't work at all.
My query is `generate 20 non-existing random English-sounding nouns, less than 6 sylabl…
-
In the HF Checkpointer, we warn the user that the adapter weights can't be converted to the PEFT format and will be converted to a torchtune format, but then we never save the adapter. [code](https://…
-
MicrosoftのminiサイズのLLM。
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
-
Follow up from https://github.com/JuliaArrays/FixedSizeArrays.jl/pull/68#issuecomment-2398328623:
> ```julia
> julia> code_llvm((FixedSizeVector{Float64,Memory{Float64}},)) do v
> for …
-
Greetings, thank you for your work.
After successful running the nvidia default variant, I tried to run the TensorRT variant (`default-nvidia-tensorrtllm`). But it does not start.
No modifications t…
ht-sp updated
1 month ago
-
Hi,
I've trying to serve different Phi3 models using the Llama.cpp server that is created by the init-llama-cpp ipex.
When I server with this version I have two problems:
1) The server doesn…
hvico updated
2 months ago
-
## 🐛 Bug
## To Reproduce
Using this model [Phi-3-vision-128k-instruct](https://huggingface.co/microsoft/Phi-3-vision-128k-instruct)
I got some bugs, need your help !!!
For phi3-v problem, w…
-
Does ctranslate2 to have plans to support the recently released small, medium, and vision. I've tried running them with transformers (on Windows) and can't get past a Triton and compiler not found ki…
-
I was attempting to run this on Windows (not WSL) and was not able to get it running. After some troubleshooting here were the main takeaways:
- To prevent dependency issues it was best to install `t…