-
Hi, thanks for the awesome work in this repo... really helpful..
Had successfully trained `TheBloke/wizardLM-13B-1.0-fp16` model on `alpaca-clean` dataset.
Then while merging(notice the use of …
-
### Describe the bug
I am using `--cpu` flag onto run the GGML models (specifically WizardLM-30B-Uncensored-GGML) entirely into RAM as I don't have much VRAM.
In the chat and chat-instruct mode t…
-
### Describe the bug
error with monkeypatch and model gpt-j and lora
Hello, I would like to discuss a problem I have with only the 4bit quantized gpt-j models (gpt-j-6B-alpaca-4bit-128g) with the …
-
what are the min req for cpu ? I ran this on i7 32g ram
but ran for over 20min with no answer / then killed it used the .env default models as noted in readme
anytricks to get this up and working on…
-
### Describe the bug
![image](https://github.com/oobabooga/text-generation-webui/assets/7551638/2dcf30dc-44f1-489d-80fd-e97d30a1cb31)
I'm not sure what has happened but oobabooga now no longer l…
-
WizardLM is the best 7B parameters model right now and is not possible to use it with this solution. Are you planning to update the shared libraries? Or is it a way to set my own Linux binary so I can…
-
### Describe the bug
When I try to train on cpu, I get the following error.
llama.cpp: loading model from models\keldenl_Dante_1.3B3-GGML\ggml-model-q5_1.bin
error loading model: missing tok_em…
wd5dw updated
11 months ago
-
I've been tracking the Falcon https://github.com/ggerganov/ggml/pull/231 PR, and as I understand currently it won't work on a released version of `ggml`.
Any suggestions on how to test it config wi…
-
### Issue you'd like to raise.
I am trying to follow the basic python example. I have downloaded the model `.bin` file as well from gpt4all.io: https://gpt4all.io/models/ggml-vicuna-13b-1.1-q4_2.bin
…
-
**Describe the bug and how to reproduce it**
First, I ingested some 4 files (txt and doc) from the source_documents folder. Then said `Hello` in the shell for the first query
**Expected behavior…