FEATURE REQUEST: Add new models automatically using a YAML file

n4ze3m / dialoqbase

Create chatbots with ease

https://dialoqbase.n4ze3m.com/

MIT License

1.53k stars 251 forks source link

FEATURE REQUEST: Add new models automatically using a YAML file #247

Open mjtechguy opened 2 months ago

mjtechguy commented 2 months ago

Hello,

I would like to be able to load new models automatically (specifically for Ollama) using a YAML config file.

Maybe something like dialoqbase.yaml with the following:

API_TYPE=Ollama OLLAMA_URL=http://ADDRESS:11434 MODEL_ID=llama2 MODEL_NAME=llama2 STREAMING=true

Also, maybe add something to hide the default ones:

HIDE_DEFAULT=true

Would that be possible? Thanks!

n4ze3m commented 2 months ago

Hey, I think you can load Ollama models via the UI. Instead of that, automatically load newly added Ollama models, right?

n4ze3m commented 2 months ago

Hey @mjtechguy, just to confirm, do you mean "a feature to automatically load newly added Ollama models," right? Also, Dialoqbase has a Discord server: https://discord.com/invite/SPE3npH7Wu.

mjtechguy commented 2 months ago

Sorry, was traveling. So, where right now you have to manually add Ollama models and embedding models in the UI.

It would be great if these could be configured at deployment time so that they already exist when a user logs in. Also, it would be nice to hide the other default models from the list if this was used in a completely private way.

n4ze3m commented 1 month ago

Hey, there are new model settings in the application section where you can dynamically configure fetching the ollama model, hide default third-party models, etc. Please let me know if you encounter any issues.