InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
12 stars 2 forks source link

Support fall back across several providers #60

Open kerthcet opened 5 months ago

kerthcet commented 5 months ago

For example: when calling OpenAI failed, fall back to other providers like VertexAI

kerthcet commented 5 months ago

/kind feature

kerthcet commented 5 months ago

Also including retry logics.

kerthcet commented 4 months ago

/close

kerthcet commented 4 months ago

/reopen

kerthcet commented 4 months ago

/retitle Support fall back across several providers

kerthcet commented 4 months ago

/priority important-longterm

kerthcet commented 4 months ago

/milestone v0.0.16

kerthcet commented 4 months ago

/milestone v0.0.16

kerthcet commented 4 months ago

/milestone clear

kerthcet commented 4 months ago

/retitle Support fall back across several providers

kerthcet commented 4 months ago

/triage needs-information