Open realies opened 2 weeks ago
There's no consistency with how APIs report this. The only way is using their specific APIs for querying that information, and those are also not consistent between providers.
would it work if the pipelines manifolds reply with a standard openai-like response about it so it works across api providers?
Returning non-standard response bodies is a good way to break compatibility with downstream clients that aren't expecting it. It would need to be it's own API, similar to how valves are handled, meaning it'd only work with Open WebUI unless other clients adopted that spec.
at the moment, for example, i see an error message like this in open-webui instead