-
### Model description
Can you please add support for the Phi-2 and the Ohi-3 mini models.
The Phi-3 supports onnx, so I'm hoping it should work:
https://huggingface.co/microsoft/Phi-3-mini-128k-in…
-
https://huggingface.co/Kooten/DaringMaid-20B-V1.1
^ That model has much better results than the original DaringMaid 20b from Kooten in terms of sticking with context.
I have wanted to use a Q8_0 …
-
### System Info
Command Causing Issue:
```
model=microsoft/Phi-3-mini-4k-instruct
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
docker run -…
-
Really nice work! Could the author also provide the hyperparameters used for training the phi-3 mini backbone (i.e., pretrain.sh and finetune_lora.sh)?
In addition, during my training process, I n…
-
Hi unsloth team. I'm wondering if you have plans for supporting the [microsoft/Phi-3-mini-128k-instruct](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct)?
Also, is it viable for a average …
-
### What is the issue?
ollama can import them, but not run them.
(Pythogora) developer@ai:~/PROJECTS/autogen$ ~/ollama/ollama run phi-3-mini-128k-instruct.Q6_K
Error: llama runner process no long…
-
I have installed h2ogpt on ubuntu22.04 as per procedure. But when I run the following command I get an error of missing **config.json** file. Please let me know how to overcome this error.
The comm…
-
hi, can I knew the exact syntax, mine is still error:
```python
model = dict(
freeze_llm=True,
freeze_visual_encoder=True,
llm=dict(
attn_implementation='eager',
p…
-
![image](https://github.com/unslothai/unsloth/assets/112067823/dfa67ca1-2048-4e2f-9abd-a3117e0e4f76)
I have just ran the code itself and it raises error at this part. What would be the reason? Than…
-
## Description
I generated Phi-3-mini-4K-instruct `engine` based on `./example/phi/README.md` and wanted to analyze it by trt-enging-explorer in trt. However, trex told me `getPluginCreator could…