Fall back support across several providers

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

MIT License

6 stars 2 forks source link

Open kerthcet opened 4 days ago

kerthcet commented 4 days ago

For example: when calling OpenAI failed, fall back to other providers like VertexAI

kerthcet commented 4 days ago

/kind feature

kerthcet commented 4 days ago

Also including retry logics.