Open ishaan-jaff opened 1 year ago
[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: ishaan-jaff
To complete the pull request process, please assign simfg after the PR has been reviewed.
You can assign the PR to them by writing /assign @simfg
in a comment when ready.
The full list of commands accepted by this bot can be found here.
Welcome @ishaan-jaff! It looks like this is your first PR to zilliztech/GPTCache 🎉
@cxie @SimFG @xiaofan-luan saw adding new LLM models was on the roadmap, made a PR to integrate with liteLLM which adds new LLM models. if this looks good would love to add support to GPTCache
@ishaan-jaff thanks for your pr, please make the dev branch as the target
what would next steps on this PR be? @ishaan-jaff @SimFG
@ishaan-jaff please add some test cases for your pull request
I'm the maintainer of litellm https://github.com/BerriAI/litellm - a simple & light package to call Bard, Anthropic, Cohere, Azure, OpenAI LLM Models
This PR adds support for models from all the above mentioned providers, in this pr I made a new adapter called litellm.py
Here's a sample of how it's used: