-
### Describe the bug
It seems like two errors pop up
"ERROR: Wheel 'rouge-score' located at C:\users\user\appdata\local\pip\cache\wheels\1e\19\43\8a442dc83660ca25e163e1bd1f89919284ab0d0c1475475148\r…
-
Hello,
I downloaded this last night:
VPTQ-community_Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft
I ran it in Oobabooga. It loaded fine. But when I tried to talk to the model (chat-instru…
-
I've seen the struggles with flash attention and was wondering if some of these pre-built wheels would work. They help a ton on Windows because flash retention on Windows is a struggle.
I first saw t…
-
### Validations
- [ ] I believe this is a way to improve. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](https://githu…
-
**Describe the bug**
I configured oobabooga as embedding provider:
- Host: `127.0.0.1`
- Port: `5000`
- Path: `/v1/embeddings`
- Model name: `all-mpnet-base-v2`
When I now select the provider …
allo- updated
3 weeks ago
-
as the title asks,
currently i cannot get this to work with oobabooga, all other models i download other than those from here are working, not sure what i am doing wrong, thanks for any help
-
### Which API Provider are you using?
OpenAI Compatible
### Which Model are you using?
qwen2.5-0.5B
### What happened?
I run Oobabooga's text-generation-webui with docker on Ubuntu20.04, and choo…
-
![Captura de tela 2024-10-06 150723](https://github.com/user-attachments/assets/7…
-
Any chance you'd consider adding Oobabooga support as a provider?
https://github.com/oobabooga/text-generation-webui
They have an API that is "drop in compatible" with OpenAI so maybe it wouldn't …
-
e.g https://github.com/oobabooga/text-generation-webui/wiki/12-%E2%80%90-OpenAI-API you just need to send the open ai api requests to a local endpoint 127.0.0.1:5000. also maybe gather money to finetu…