search

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
26.74k stars 2.67k forks source link

[FEAT]: Add model support to Oobabooga Web UI #1503

Closed Matti-Koopa closed 4 months ago

Matti-Koopa commented 5 months ago

What would you like to see?

Add a text box for model configuration to Oobabooga text generation web ui. model is already in "Generic OpenAI" and as such could immediatly be copied over (as it's the same JSON syntax as well).

timothycarambat commented 5 months ago

Can Oobabooga serve more than a single model at once? The reason the field does not exist is because when integrating we did not see that option to hot-load multiple models at once

shatfield4 commented 4 months ago

Oobabooga Web UI still does not support multiple models.