Open ishaan-jaff opened 10 months ago
@sonichi @qingyun-wu can i get a review on this pr ?
happy to add docs/tests of this initial commit looks good to you
Hi @ishaan-jaff, Thanks for the contribution. This support looks appealing! But is it a good way to directly replace openai_completion? I am concerned about the potential unexpected consequences of this replacement. How about adding a LiteLLM option and using LiteLLM when the user explicitly configures so?
This PR adds support for the above mentioned LLMs using LiteLLM https://github.com/BerriAI/litellm/ LiteLLM is a lightweight package to simplify LLM API calls - use any llm as a drop in replacement for gpt-3.5-turbo.
Example
Why are these changes needed?
Related issue number
Checks