Closed eljamm closed 5 months ago
The problem is that you can only have one script with the same id. Means, if you have multiple different local (or remote) backends, then you can only use one with this script. So if you want to make one script for all use cases, please create a new script that supports multiple backends and also give hints about the API end points of the different backends...
I, for example, wasn't aware that the chat API of ollama was not the OpenAI compatible API!
Any OpenAI-compatible backend is supported, so it would be better to maintain them in a single script and have seperate scripts for the ones that aren't compatible.
This would also be clearer for users which might wrongly assume that only one backend is supported.
This change also automatically adds the OpenAI endpoint to the base URL because all compatible backends support it already. Therefore, users only need to provide the local address.