-
Using the following code yields a no-support error. Would love to see the model supported since it's currently one of the few Finnish-language LLMs.
```
from unsloth import FastLanguageModel
impo…
-
I'm fiddling with transformers_js_py and getting a:
Unknown typed array type 'BigInt64Array'. This is a problem with Pyodide, please open an issue about it here: https://github.com/pyodide/pyodide/…
-
### System Info
Command Causing Issue:
```
model=microsoft/Phi-3-mini-4k-instruct
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
docker run -…
-
Microsoft recently released Phi-3 models in 3 variants (mini, small & medium). Can we add support for this new family of models.
-
### What is the issue?
I get a CUDA out of memory error when sending large prompt (about 20k+ tokens) to Phi-3 Mini 128k model on laptop with Nvidia A2000 4GB RAM. At first about 3.3GB GPU RAM and …
-
### What is the issue?
ollama can import them, but not run them.
(Pythogora) developer@ai:~/PROJECTS/autogen$ ~/ollama/ollama run phi-3-mini-128k-instruct.Q6_K
Error: llama runner process no long…
-
When I run an inference in alpaca format several times it starts to look like this with phi 3 mini:
![image](https://github.com/unslothai/unsloth/assets/39015765/b4a49bbf-def3-4c98-aa0d-391dfd027fc…
-
### System Info
transformers: 4.45.0.dev0
torch: 2.5.0.dev20240716+cpu
### Who can help?
@ArthurZucker
@gante
@zucchini-nlp
### Information
- [ ] The official example scripts
- [X] My own modi…
-
Server:
```sh
toolio_server --model=mlx-community/Phi-3-mini-128k-instruct-4bit
```
Client:
```sh
toolio_request --apibase="http://localhost:8000" --prompt='What is the average airspeed of…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.8.2
- Platform: Linux-5.15.0-1040-azure-x86_64-with-glibc2.17
- Pytho…