feature: ability to change baseURL for AI assistant

windmill-labs / windmill

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

https://windmill.dev

Other

9.62k stars 440 forks source link

feature: ability to change baseURL for AI assistant #4252

Open KrisF-Midnight opened 1 month ago

KrisF-Midnight commented 1 month ago

Currently we can only enter the OpenAI api key. However many other LLM providers are using the same openAI API structure, just with different api url (like openrouter) The changes needed here are to

add one more box to enter a different baseUrl instead of defaulting it to openai
add another box to enter manually the llm model to use, like openai/gpt-4o-mini Example: https://openrouter.ai/docs/quick-start

This would enable us to use AI assist with other providers, not just openai.

rubenfiszel commented 1 month ago

Currently we support this but only on the enterprise edition. We'd want to keep local and private ai providers on the enterprise edition but give the choices to all the public apis in the future.

rubenfiszel commented 1 month ago

Re-opening this as openrouter might actually fit the bill of only allowing public providers

KrisF-Midnight commented 4 weeks ago

Thank you, this would be AMAZING!