-
### Describe the bug
python server.py --share --model liuhaotian_llava-v1.5-13b --multimodal-pipeline llava-v1.5-13b --load-in-4bit
18:26:56-770141 INFO Starting Text generation web UI …
-
Diffusers recently added support for the following models:
- [ ] [Kolors](https://github.com/huggingface/diffusers/pull/8812) (@tuanh123789)
- [ ] [AuraFlow](https://github.com/huggingface/diffusers…
-
### What is the issue?
I love using llama3:8b with Open WebUI's text generation and recently I've realized whatever I write there llama3:8b just says random stuff.
After that I've tried the messag…
-
### What happened?
Since commit b3188 llama-cli produce incoherent output on multi-gpu system with CUDA and row tensor splitting.
Layer tensor split works fine but is actually almost twice slower.
…
-
Gives error about not being able to install correctly. Tried some stuff but it just doesn't work in latest A1111 (1.6.0)
-
Hello,
I see ip-adapter-full-face_sd15.bin has been recently released. Could you explain what is the difference between this and previously released version of IP-Adapter-Face? Also, is this just f…
-
A new sampler named 'DRY' appears to be a much better way of handling repetition in model output than the crude repetition penalty exposed by koboldcpp.
https://github.com/oobabooga/text-generatio…
-
Hello.
When I try to generate an image in Flux mode using the flux1-dev-bnb-nf4.safetensors model on my macbook, I get the following error:
> 0%| …
-
Hi,
For my usage I am feeding the engine the sentence word by word.
using the SystemEngine I got a somewhat coherent sentence (the words were clear but the sentence was too fast),
but when using th…
-
Thanks for the wonderful job!
I want to known when release the doc of Data Preparation.
Thanks very much!