-
https://github.com/oobabooga/text-generation-webui
我用的int4版本
加载模型时，提示
OSError: models/ChatLLaMA-zh-7B-int4 does not appear to have a file named config.json
需要一个config.json ?
-
File "/UNICOMFS/hitsz_mzhang_1/.conda/envs/quantize/lib/python3.9/site-packages/transformers/models/gpt_neox/modeling_gpt_neox.py", line 155, in forward
qkv = self.query_key_value(hidden_states…
-
### Describe the bug
It'll be my first time using it, I am currently using Automatic1111 and Forge for StableDiffusion and I understand a couple of things and have some needed things like Python and …
-
I am seeinng the following error when the extension is loading and I wondered if anyone had any pointers? coqui_tts extension is working ok.
I noted when I installed TTS like this `pip install TTS …
-
Any chance you'd consider adding Oobabooga support as a provider?
https://github.com/oobabooga/text-generation-webui
They have an API that is "drop in compatible" with OpenAI so maybe it wouldn't …
-
Running on local URL: http://127.0.0.1:7860
Could not create share link. Please check your internet connection or our status page: https://status.gradio.app.
![image](https://github.com/user-at…
-
I am running the FP16 version of Flux and the fp16 T5 text encoder on my RTX 2060 laptop with 32 GB RAM. I was surprised to see WebUI forge having faster speeds by multiple magnitudes compared to Comf…
-
-edit- found out more about the issue and added another comment as it affects transformers as well.
**Describe the bug**
This issue seems to be related to using HF model loaders. I don't know wha…
-
### Describe the bug
When running the start_windows.bat file in the Windows interface, ModuleNotFoundError: No module named 'yaml' appears
**And I entered pip list in cmd_windows.bat and found onl…
-
I cannot compile the wheels. whether I use winglian or old_compatible, I end up with this error message.
` RuntimeError: Error compiling objects for extension
[end of output]
note: …