-
Hi!
I use the lib rocblas.for.gfx90c.workable that works perfectly on my Ryzen 7 5700g, it has worked without problems in Comfy and Stable Difussion, but when I try to use it in Text-Generation-Web…
-
openbmb/MiniCPM-2B-sft-bf16 on Text Generation WebUI issue on ubuntu22.04:
set up the webUI following similar steps as window described here: https://github.com/intel-analytics/ipex-llm/blob/ma…
-
As the title states, do we need to set the model loader to ExLlamav2_HF or ExLlamav2?
The [documentation](https://github.com/oobabooga/text-generation-webui/wiki/04-%E2%80%90-Model-Tab) says:
`…
-
### Describe the bug
Hi, to start off I thank anyone who trie to help me in any way.
So, I was trying to open Oobabooga for the first time: I let it download and install everything, I put the righ…
-
### Environment
🪟 Windows
### System
Brave Browser
### Version
Version 1.12.4
### Desktop Information
nodejs version v20.10.0
Textgen (ooba) (not sure, but I installed it two days ago, along w…
-
### Describe the bug
text-generation-webui???
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
09:47:30-526026 INFO Loading "upstage_SOLAR-…
-
Could we have support for [Llama.cpp?](https://github.com/ggerganov/llama.cpp)
That will make the model more accessible to many popular tools like Ollama, LM Studio, Koboldcpp, text-generation-webui,…
-
**Description**
Sometimes you have crashes like the ones below.
`ui_model_menu.py` is quite nice and dandy by reporting the python stack when it can, but as you can see below if you were only to …
-
### System Info
jetson-agix-orin
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported task …
-
无法加载模型,后台报错:
1.当前版本为PYTHON 3.11.9,之前试过PYTHON3.10.X也报错
2. xinference . 0.12.2
3. pip install "xinference[all]" 安装后本地环境运行
4. Full stack of the error.
Traceback (most recent call last):
File …