search

zeno-ml / zeno-build

Build, evaluate, understand, and fix LLM-based apps
MIT License
484 stars 33 forks source link

Adding support for Anthropic, Palm, AI21, Aleph Alpha, TogetherAI, #182

Closed krrishdholakia closed 1 year ago

krrishdholakia commented 1 year ago

Hi @lindiatjuatja,

Saw you support OpenAI, Azure, Cohere and HF. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.

I added support for the providers listed above by replacing the chatcompletion.acreate with acompletion. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.

Would love to know if this helps.

Happy to add additional tests / update documentation, if the initial PR looks good to you.

krrishdholakia commented 1 year ago

Hey @neubig will do. Thanks for the feedback!

krrishdholakia commented 1 year ago

Updated based on change requested by @neubig, let me know if there's any other blockers

cabreraalex commented 1 year ago

This looks awesome thanks so much!!

krrishdholakia commented 1 year ago

Thanks for the merge. Here's how to test how the new models are working: https://docs.litellm.ai/docs/proxy_api#step-2-test-a-new-llm