-
Edit: @DannyDaemonic here. (Sorry for the edit.) Here's a much simpler example. First build the cache like this:
```
./main -m /path/to/llama/bin --prompt-cache Z.cache -p "Here's a funny joke. No, …
-
### Description
When I attempt to load a local model, I encounter the error message 'str' object has no attribute 'get'. This error occurs during the process of loading the agent configuration, indic…
-
### Title
App hangs on step generating task list.
### Description
I've updated to the latest version, and am running locally not in docker.
When I add a prompt for set agent objective. It is rec…
-
Hi, How do I train a LORA with a GPTQ 4-bit model as its base? I tried with and without the new monkeypatch and with all the different model loaders. I got the furthest by trying to use AutoGPTQ witho…
-
### Describe the bug
If I am in instruct mode and superbooga is enabled, I get the error after sending the first message:
```
Traceback (most recent call last):
File "J:\oobabooga_windows\instal…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Is there any possibility of integrating Vicuna with Lanchain.
Both Vicuna and Lanchain, I believe that integrating these two powerful tools would greatly enhance their capabilities and provide users …
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ x] I am running the latest code. Development is very rapid so there are no tagged versions as o…
-
I see issue #134 mentions:
> Consider https://github.com/weaviate/weaviate if want to store both vectors and objects in db -- not necessarily wanted in general, but makes db stable against needing …
-
Hi,
Thank you, this project is amazing
At some point I got this error
> llama_eval_internal: first token must be BOS
llama_eval: failed to eval
Which throw this exception, from https://git…