Different backends support a large range of popular models, but not all models are supported, so we should have a failover policy for them, at least this policy should be supported in Playground.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
[x] Design doc
[ ] API change
[x] Docs update
The artifacts should be linked in subsequent comments.
kerthcet
commented
4 weeks ago
What would you like to be added:
Different backends support a large range of popular models, but not all models are supported, so we should have a failover policy for them, at least this policy should be supported in Playground.
Why is this needed:
Completion requirements:
This enhancement requires the following artifacts:
The artifacts should be linked in subsequent comments.