-
### Validations
- [ ] I believe this is a way to improve. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](https://githu…
allo- updated
3 weeks ago
-
### Which API Provider are you using?
OpenAI Compatible
### Which Model are you using?
qwen2.5-0.5B
### What happened?
I run Oobabooga's text-generation-webui with docker on Ubuntu20.04, and choo…
-
### Describe the bug
When running inference over openAI compatable API with Perplexica or avante.nvim the error sometimes appears, after that happnes it doesn't work anymore until I restart the progr…
-
Greetings, thank you for your work.
After successful running the nvidia default variant, I tried to run the TensorRT variant (`default-nvidia-tensorrtllm`). But it does not start.
No modifications t…
ht-sp updated
1 month ago
-
### Describe the bug
ERROR: Could not find a version that satisfies the requirement torch==2.4.1 (from versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2) …
-
### Describe the bug
When installing Silero and Whisper it gives errors
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
1. Launch webui
2. In …
-
When I try to run the default-rocm docker images it fails with the issue below, i believe i set up docker compose correctly
```
text-generation-webui | RuntimeError: Failed to import transformers.g…
-
### Describe the bug
[The model](https://huggingface.co/THUDM/codegeex4-all-9b) successfully loads in 8- and 4-bit quant, confirmed by VRAM usage observed in `nvtop`. Upon first prompting of the mode…
-
### Description
The extensions are correctly added and loaded; however, there is a need to update the requirements via:
```
pip install -r extensions/Lucid_Autonomy/requirements.txt --upgrade
``…
-
openbmb/MiniCPM-2B-sft-bf16 on Text Generation WebUI issue on ubuntu22.04:
set up the webUI following similar steps as window described here: https://github.com/intel-analytics/ipex-llm/blob/ma…