-
# Prerequisites
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-c…
-
Hello, I've been working on a **conversational model** based on Cyn from Murder Drones. I've been using **Unsloth's Llama 3 notebook** for finetuning **Llama 3.2 3B Instruct** with **my own dataset**.…
-
### What happened?
I was experimenting with the llama.cpp project and llm inference in general. I made a basic chat application (similar to the main.cpp project from the examples) but much simpler. N…
-
Error with incorrect path and How using my own dataset from csv to Fine-tune model
Load dataset
--------------------------
from datasets import load_dataset
dataset = load_dataset("nickrosh/Evol…
-
-
I downloaded the Llama3.2-1B-instruct model from here: https://www.llama.com/llama-downloads/
In the downloaded folder, some files like config.json and others (which are required during inference/f…
-
**LocalAI version: 1.22.0**
**Environment, CPU architecture, OS, and Version:**
Linux namehere 5.19.0-46-generic #47~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Jun 21 15:35:31 UTC 2 x86_64 x86_6…
-
我在本地复现qwen2-0.5B时，损失函数曲线看起来很正常，但是测试结果非常低。请问您有遇到过类似情况吗？如何能稳定训练qwen2呢
-
### Question
Thank you for your great work!
I am trying to fine-tune llava-v1.6-mistral-7b on the provided GQA dataset, using the script `finetune_task_lora.sh`. However, the loss dosen't decrea…
-
Hi, thanks for great code and amazing work
I do my best to to make similar performance but I get some trouble.
Could I get some of your advice?
1. Download dataset
Unfortunately, some of datas…