-
This thread is dedicated to discussing the setup of the webui on Intel Arc GPUs.
You are welcome to ask questions as well as share your experiences, tips, and insights to make the process easier fo…
-
### What happened?
I'm having difficulty correctly configuring LiteLLM. I am getting the following error:
```
litellm.exceptions.NotFoundError: OpenAIException - Error code: 404 - {'detail': 'N…
-
I am trying to launch llama-2 from the [oobabooga_macos repo](https://github.com/oobabooga/text-generation-webui) but am encountering errors on my MacOS as stated below:
ERROR: Failed building wheel…
-
Apologies for bringing up what is more an Ooba issue, but I am getting what seems to be incorrectly formatted outputs while querying the model through the text-generation-webui api with text completio…
-
vLLM is an open-source LLM inference and serving library that accelerates HuggingFace Transformers by 24x and powers Vicuna and Chatbot Arena.
Blog post: https://vllm.ai/
Repo: https://github.com/…
-
### Describe the bug
Got a bug when work with https://github.com/oobabooga/text-generation-webui:
```
Loading llama-7b-hf...
Loading model ...
Traceback (most recent call last):
File "C:\Use…
-
### Describe the bug
When installing on windows with option NVIDIA (A) and choosing CUDA 11.8 Support (Y), the installation is failing because of:
ERROR: HTTP error 404 while getting https://githu…
-
I followed the walk through on this video:
[https://www.youtube.com/watch?v=fNuHVok_hWY](https://www.youtube.com/watch?v=fNuHVok_hWY)
Unfortunately, I could not use the v2 of the model located at …
-
> Traceback (most recent call last):
>
> File "oobabooga/extensions/Diffusion_TTS/script.py", line 289, in output_modifier
>
> generate_audio(model, voice_samples, conditioning_latents, output…
-
### Self Checks
- [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones.
- [X] I confirm that I am using English to fi…