-
at start:
loading model:
For some reason token streaming just does not work. It's enabled and the actual terminal output from the se…
-
* Support arm
* Add a Dockerfile to the repo
* Build images in github ci and push them to dockerhub and ghcr
* Provide an example docker-compose file. This would show which volumes/mounts are avail…
-
For example, when I'm running the official version of KoboldAI, my active soft prompt will be saved and will be activated automatically the next time I start it. But when I'm running this the soft pro…
-
critical libmamba Can't create 'man/man3/Parse::CPAN::Meta.3'
error libmamba Error opening for reading "/media/muhammad/D1/Work/Sociail/KoboldAI/runtime/pkgs/perl-5.32.1-7_hd590300_perl5/info/inde…
-
Hey,
I tried using this fork and I realized that the speed was really slow for some models that I was using
https://huggingface.co/reeducator/vicuna-13b-cocktail/tree/main
For vicuna-cocktail f…
-
This is a pretty common thing for Davinci-003 to do, if it feels like not continuing, it won't, it's expecting the user to write newlines or remove periods if it wants the writing to continue. This se…
-
# 🚀 Feature request
I would like to have Huggingface implement Tail Free Sampling, or TFS for short, to the official repo. The original paper for this can be found here: https://trentbrick.github.i…
-
```"B:\python\lib\site-packages\torch\lib\nvfuser_codegen.dll" or one of its dependencies.```
I ran the mentioned bat file, as I read recent issues, yet this did not help me fix the problem. The fi…