-
openbmb/MiniCPM-2B-sft-bf16 on Text Generation WebUI issue on ubuntu22.04:
set up the webUI following similar steps as window described here: https://github.com/intel-analytics/ipex-llm/blob/ma…
-
As the title states, do we need to set the model loader to ExLlamav2_HF or ExLlamav2?
The [documentation](https://github.com/oobabooga/text-generation-webui/wiki/04-%E2%80%90-Model-Tab) says:
`…
-
### Describe the bug
Hi, to start off I thank anyone who trie to help me in any way.
So, I was trying to open Oobabooga for the first time: I let it download and install everything, I put the righ…
-
### Environment
🪟 Windows
### System
Brave Browser
### Version
Version 1.12.4
### Desktop Information
nodejs version v20.10.0
Textgen (ooba) (not sure, but I installed it two days ago, along w…
-
**Description**
Sometimes you have crashes like the ones below.
`ui_model_menu.py` is quite nice and dandy by reporting the python stack when it can, but as you can see below if you were only to …
-
Could we have support for [Llama.cpp?](https://github.com/ggerganov/llama.cpp)
That will make the model more accessible to many popular tools like Ollama, LM Studio, Koboldcpp, text-generation-webui,…
-
### Describe the bug
text-generation-webui???
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
09:47:30-526026 INFO Loading "upstage_SOLAR-…
-
无法加载模型,后台报错:
1.当前版本为PYTHON 3.11.9,之前试过PYTHON3.10.X也报错
2. xinference . 0.12.2
3. pip install "xinference[all]" 安装后本地环境运行
4. Full stack of the error.
Traceback (most recent call last):
File …
-
### Describe the bug
I tried both the manual install and the one click install for Linux. My OS is a fresh install of Ubuntu 24.04. I've previously used this model on Windows 10 with text-generation-…
-
01:54:47-255686 INFO Starting Text generation web UI
01:54:47-260684 WARNING trust_remote_code is enabled. This is dangerous.
01:54:47-268684 INFO Loading the extension "openai"
01:54:47-4…