-
Hi, I'm running Windows 7 and got the above error message. Similar issue can be found here: https://github.com/ggerganov/llama.cpp/issues/894
And one possible solution might be in:
https://github.c…
-
Maybe it's a silly question, but, where can I find the sources for:
- koboldcpp.dll
- koboldcpp_clblast.dll
- koboldcpp_noavx2.dll
- koboldcpp_openblas.dll
- koboldcpp_openblas_noavx2.dll
- cl…
-
Hi everyone,
When I compare the output I see from koboldcpp in the console to the output that gets sent to the lite web UI, I notice that often, there is a bit of output in the console, always at th…
-
Since the latest release added support for cuBLAS, is there any chance of adding Clblast?
Koboldcpp (which, as I understand, also uses llama.cpp) already has it, so it shouldn't be that hard.
-
### Description
Hello dear Josh-XT, after restarting the AGiXT containers, when I go to the agents configuration tab, it needs to download about 200 megabytes of data from the Internet. If the Int…
-
I am running the latest code.
I was expecting a way to load the models from gptneox directly by running some kind of binary "main-gptneox" or something similar, instead, I see a ".so" library. Is t…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
llava-v1.6-vicuna-7b-Q5_K_M.gguf
llava-v1.5-7b-Q4_K
dont work with images (that are version v1)
i have downloaded the llava model you suggested !
your model
LlaVa 1.5 7B Q5 K is v1.1
thats wo…
-
Hello guys,
I was just able to compile the project succesfully at Windows using w64devkit version 1.18.0 .
The problem I had is that I was using the binaries directly at my PATH, and I needed t…