-
```
│ 154 │ │ lens = len(data_point['input']) │
│ 155 │ │ for i in range(lens-1): …
-
### Contact Details
github
### What happened?
I came here to report the issue / bug / my incompetence around the error of: `llama_model_load: error loading model: done_getting_tensors: wrong numbe…
-
您好,我在执行qlora微调复现时遇到这个问题,报错信息是:
Traceback (most recent call last):
File "../finetune_llama3.py", line 452, in
train()
File "../finetune_llama3.py", line 445, in train
trainer.train()
…
-
I generated my own lora adapters using the finetune executable from the llama.cpp repository, when I tried to use them in llama.cpp using .bin it works, but the .gguf returns "bad file magic". The thi…
-
![image](https://user-images.githubusercontent.com/5949853/225432184-384aa8f2-0da0-47b8-957c-ecc6e8acef6a.png)
NeoX 20B is larger than most non-professional environments can manage. The reduce meas…
-
### What happened?
direct llama-cli call for Flan-T5 based models working fine. When trying to set up server, critical error stop execution
```
.\llama-server.exe -m .\models\LaMini-Flan-T5-248M.Q…
-
```
➜ go-ggllm.cpp git:(master) ✗ CGO_LDFLAGS="-lcublas -lcudart -L/usr/local/cuda/lib64/" LIBRARY_PATH=$PWD C_INCLUDE_PATH=$PWD go run ./examples -m "/media/NAS/MLModels/02_LLMs/falcon-40b-instruct…
-
Hi, thanks for great code and amazing work
I do my best to to make similar performance but I get some trouble.
Could I get some of your advice?
1. Download dataset
Unfortunately, some of datas…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…
-
The license of the finetuned checkpoints currently makes no sense.
The base model was almost certainly trained on a ton of unlicensed all-rights-reserved data. In particular, the README says that i…