-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
### User Story
**As a** user
**I want** LeapfrogAI to gracefully handle overextending context window
**So that** I don't start getting gibberish when the context window is exceeded.
### A…
-
### What is the issue?
Hi,
I am trying to run the 16b ollama deepseek-coder-v2, which leads to a "gibberish" output.
Strangely enough it works after a fresh download, but then after trying to run…
-
Hi, I followed these instructions and downloaded the models, but the output looks like gibberish... (I don't have a working cuda card, so I hope it's using cpu?)
```
conda env create -f environmen…
-
### System Info
GPU: RTX4090
Run 2.1.0 with docker like:
`docker run -it --rm --gpus all --ipc=host -p 8080:80 -v /home/jp/.cache/data:/data ghcr.io/huggingface/text-generation-inference:2.1.0 …
-
### What is the issue?
Mixtral 8x22b instruct outputs are either empty or gibberish.
I have tried various quantizations: q4, q4_k_m, q5, etc. All seem problematic.
Other models (e.g., llama3, com…
-
### What is the issue?
The Model being Deepseek Coder v2 16b q: 5_K_M
I provided a code block to the model and it started to produce gibberish. Whereas for any other model, it works fine.
![Screens…
-
I have compiled a text file that contains erroneous copyright detection values. I have removed quote characters and separated each copyright value by several lines.
[bad-copyright-detections.txt](htt…
-
After training for 1000 iters and ensuring the model is saved every 100 iters, the model sampling is gibberish:
```
For that, being one o' the lowest, basest, poorest,
Of this most wise rebellion…
-
Hi, I trained the model as described and used my final model to run inference.py, however, it seems to give me a gibberish output. I was wondering if you could post weights that you obtained during yo…