open-webui / pipelines

Pipelines: Versatile, UI-Agnostic OpenAI-Compatible Plugin Framework
MIT License
714 stars 202 forks source link

improve ux when out of credits with a 3rd party api #248

Open realies opened 2 weeks ago

realies commented 2 weeks ago

at the moment, for example, i see an error message like this in open-webui instead Screenshot 2024-09-05 at 18 02 17

justinh-rahb commented 1 week ago

There's no consistency with how APIs report this. The only way is using their specific APIs for querying that information, and those are also not consistent between providers.

realies commented 1 week ago

would it work if the pipelines manifolds reply with a standard openai-like response about it so it works across api providers?

justinh-rahb commented 1 week ago

Returning non-standard response bodies is a good way to break compatibility with downstream clients that aren't expecting it. It would need to be it's own API, similar to how valves are handled, meaning it'd only work with Open WebUI unless other clients adopted that spec.