Feature Request: Manage model through UI instead of updating .env.local

TriEyeMonster commented 3 months ago

Since the website will be running in a production environment, it will be better that admin is able add or remove model through UI instead of a production deployment for a minor .env.local update.

nsarrazin commented 3 months ago

Yeah that would be definitely be nice, I think it was on our roadmap a while ago but never got prioritized. If there's strong demand we could try to tackle this! It would make life a lot easier for self-hosting users.

TriEyeMonster commented 3 months ago

Yeah, this is a essential feature if we want to make it more product ready.

widyaageng commented 3 months ago

+1 for prioritisation.

neven4 commented 3 months ago

@nsarrazin how do you think we should handle endpoints array in the Modal collection? Currently, we have a union of Endpoint types (I think it will be hard to create one unified collection from them).

So,

do we want to have an additional mongo collection for each endpoint type (with their own schema): AwsEndpointSchema, OpenaiEndpointSchema, AnthropicEndpointSchema
or, just create a collection with type (aws, openai, anthropic) and json (each endpoint schema will have it's own structure) and validate it from the frontend side (like we do right now)?

huggingface / chat-ui

Feature Request: Manage model through UI instead of updating .env.local #1286