What would it take to have multi-llm support ? I'm working on a SAAS product where we allow the end-user to choose between various providers (for cost, fit and latency reasons), so for us this feature is important. I may have some resources available to devote to this if it's attainable with not too much of a lift.
Is there an interface that the OpenAI integration uses that is sufficiently general to be a basis for other implementations ?
Code of Conduct
[X] I agree to follow this project's Code of Conduct
Feature Request
What would it take to have multi-llm support ? I'm working on a SAAS product where we allow the end-user to choose between various providers (for cost, fit and latency reasons), so for us this feature is important. I may have some resources available to devote to this if it's attainable with not too much of a lift.
Is there an interface that the OpenAI integration uses that is sufficiently general to be a basis for other implementations ?
Code of Conduct