-
OS: 22.04.1-Ubuntu
Python: Python 3.12.2
Build fails for llama-cpp-python
```
$ pip install -r requirements.txt
...
Building wheels for collected packages: llama-cpp-python
Building wheel…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.9.1.dev0
- Platform: Linux-6.5.0-35-generic-x86_64-with-glibc2.35
- P…
-
### 🐛 Describe the bug
I attempted to train LLaVA (base LLM = LLaMA 3) using the Liger kernel. The loss graph was similar to when I trained LLaVA without the Liger kernel. However, the model traine…
-
When I tried to run the code [here](https://github.com/LLaVA-VL/LLaVA-NeXT/blob/main/docs/LLaVA-NeXT.md), I encountered the following problem:
```
Traceback (most recent call last):
File "/home…
-
**LocalAI version:**
localai/localai:latest-gpu-nvidia-cuda-12 : SHA ff0b3e63d517
(Also occurs on v2.22.1 container image)
**Environment, CPU architecture, OS, and Version:**
Linux server 6.8.0-…
-
# Prerequisites
When I install via pip install llama-cpp-python, there will be an error. It will occur on versions 0.2.81 and 0.2.80, The version 0.2.79 can be successfully installed.
python 3.11…
-
# Current Behavior
I run the following:
CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --verbose
an error occured:
ERROR: Failed building wheel for llama-cpp-python
# Environment …
-
I tried using Vision models like llama-3.2-90b-vision-preview, llama-3.2-11b-vision-preview, llava-v1.5-7b-4096-preview but it shows same thing as:
![image](https://github.com/user-attachments/assets…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
```
- `llamafactory` version: 0.9.1.dev0
- Platform: Linux-4.19.90-2107.6.0.0192.8.oe1.bclinux.x86_64-x…
-
Dear @xiaoachen98,
Thank you very much for releasing the code. I am running your fine-tuning script to replicate your LLaMA 3 results. However, I am getting zero loss after the first iteration. Hav…