search

windmill-labs / windmill

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.
https://windmill.dev
Other
10.97k stars 536 forks source link

feature: custom openai base url #4572

Open ImSingee opened 1 month ago

ImSingee commented 1 month ago

Now windmill supports OPENAI_AZURE_BASE_PATH to use azure instead of OpenAI.

But I may want to use other third-party solutions, like openrouter or cloudflare ai gateway.

Azure uses a different way to pass the API key compared to openai. But other providers use the same way as OpenAI. So just use their endpoint as OPENAI_AZURE_BASE_PATH doesn't work.

rubenfiszel commented 1 month ago

Just a note that the fact OPENAI_AZURE_BASE_PATH is available on community is currently an oversight considering in the UI it's marked as an ee feature. We will later refactor the ai integration to allow for more public ais but we will also restrict private and local models to enterprise and remove OPENAI_AZURE_BASE_PATH for being available in non ee.