feature: ability to change baseURL for AI assistant

windmill-labs / windmill

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

https://windmill.dev

Other

11.05k stars 541 forks source link

feature: ability to change baseURL for AI assistant #4252

Open KrisF-Midnight opened 3 months ago

KrisF-Midnight commented 3 months ago

Currently we can only enter the OpenAI api key. However many other LLM providers are using the same openAI API structure, just with different api url (like openrouter) The changes needed here are to

add one more box to enter a different baseUrl instead of defaulting it to openai
add another box to enter manually the llm model to use, like openai/gpt-4o-mini Example: https://openrouter.ai/docs/quick-start

This would enable us to use AI assist with other providers, not just openai.

rubenfiszel commented 3 months ago

Currently we support this but only on the enterprise edition. We'd want to keep local and private ai providers on the enterprise edition but give the choices to all the public apis in the future.

rubenfiszel commented 3 months ago

Re-opening this as openrouter might actually fit the bill of only allowing public providers

KrisF-Midnight commented 3 months ago

Thank you, this would be AMAZING!

boredjoker commented 1 week ago

anything update here? I really want to use open router replace openai