-
Hello, I keep trying to train a model using AutoTrain with my own training data and it keeps doing what the title says
Model: https://huggingface.co/meta-llama/Meta-Llama-3-8B
Dataset:
[coolbot …
-
### Bug Description
I was trying to do Tree Summarize with llamacpp and Mistral-7b. However, I encountered an issue where the model has a default BOS token embedded. When I use promptemplate a BOS …
-
I applied and downloaded the model files **Meta-Llama-3-8B-Instruct** via the official script: https://github.com/meta-llama/llama3/blob/main/download.sh. and put the model files in local folder: /dat…
-
I was trying this model https://huggingface.co/ddh0/Meta-Llama-3-8B-Instruct-bf16-GGUF
By varying the prompt it randomly works sometimes. When offloading layers to the GPU it seems to crash no matt…
-
I was testing the new quantize by @angeloskath with some Italian prompts that were failing with previous version and now are PERFECT! But while doing this I have seen extreme slowness with q8 and fp16…
-
Hi,
I received a weird error in a workflow that was previously working. Not sure if the "TODO: fix" mention is intended for comfyui, for llama_cpp, or for VLM nodes, but I figured I'd start here :). …
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.8.3.dev0
- Platform: Linux-5.15.0-112-generic-x86_64-with-glibc2.31
- Pytho…
-
I'm getting this error when using --quantkv with Metal.
```
GGML_ASSERT: ggml-metal.m:924: !"unsupported op"
```
>python3.11 koboldcpp.py Mistral-7B-Instruct-v0.3-Q8_0.gguf --nommap --flashattenti…
-
![image](https://github.com/huxiao09/QPA/assets/49807276/e5895ca5-104b-4196-a884-7c5bcf880a91)
I'm interested in understanding the rationale behind not incorporating data augmentation techniques in…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…