Please do not request features for the model as an issue. You can refer to the pinned Discussion thread to make feature requests for the model/dataset.
Please describe what you are trying to do with the component
When setting up an LLM using the generic OpenAI-compatible API option, it would be nice to be able to set a custom path.
Describe the solution you'd like
When setting up a generic OpenAI-compatible API, the service's URL must take the form of http(s)://<domain ("API Hostname")>:<port>/, but some, like Groq, use e.g. https://api.groq.com(:443)/openai/ for their OpenAI-compatible API. There is currently no way to add a custom path for a situation like this. It would be good to be able to add a custom path to support such services.
Additional context
Add any other context or screenshots about the feature request here.
acon96
commented
2 weeks ago
Please do not request features for the model as an issue. You can refer to the pinned Discussion thread to make feature requests for the model/dataset.
Please describe what you are trying to do with the component
When setting up an LLM using the generic OpenAI-compatible API option, it would be nice to be able to set a custom path.
Describe the solution you'd like
When setting up a generic OpenAI-compatible API, the service's URL must take the form of
http(s)://<domain ("API Hostname")>:<port>/, but some, like Groq, use e.g.https://api.groq.com(:443)/openai/for their OpenAI-compatible API. There is currently no way to add a custom path for a situation like this. It would be good to be able to add a custom path to support such services.Additional context
Add any other context or screenshots about the feature request here.