-
Hello !
Forge with flux does'nt work this morning.
but yesterday: yes.
Neveroom seems not working (???)
Thanks !
On My HDD (D:), i have 110go free .....
```
Python 3.10.11 (tags/v3.10…
-
I have been informed that while Flash Attention's there it's not being used -
https://github.com/oobabooga/text-generation-webui/issues/3759#issuecomment-2031180332
The post has a link to what has …
-
Can't load any models anymore. Here is the traceback:
Traceback (most recent call last):
File "/workspace/text-generation-webui/modules/ui_model_menu.py", line 243, in load_model_wrapper
sh…
-
[XTTS] Loading XTTS...
Traceback (most recent call last):
File "K:\text-generation-webui\installer_files\env\Lib\site-packages\gradio\queueing.py", line 407, in call_prediction output = await r…
-
So I did a conversation with my chatbot in solar 7B .awq and this extension worked fine
Then I switched to a .gptq quant of the same model and continued the conversation and this is what I got
`Tr…
-
### Describe the bug
I tried to load llama 3 8b safetensor model but it doesnt work.
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
Download .…
-
**env:**
transformers ==4.35.2
ctransformers==0.2.27+cu121
```
from ctransformers import AutoModelForCausalLM, AutoTokenizer
model_name = "/home/me/project/search_engine/text-generation-web…
-
Explore [text-generation-webui](https://github.com/oobabooga/text-generation-webui/) to serve language models on ODH.
How flexible is it for different models?
Would we need a custom server.py f…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
https://huggingface.co/acon96/Home-3B-v2-GGUF/resolve/main/Home-3B-v2.q8_0.gguf
https://github.com/abetlen/llama-cpp-python/releases/tag/v0.2.29
AMD Vega64 Unbuntu 22
On v1 it loaded fine on…