iuiaoin / wechat-gptbot

A wechat robot based on ChatGPT with no risk, very stable! 🚀
MIT License
579 stars 113 forks source link

Add support for Azure, OpenAI, Palm, Anthropic, Cohere Models - using litellm #77

Closed ishaan-jaff closed 1 year ago

ishaan-jaff commented 1 year ago

I'm the maintainer of litellm https://github.com/BerriAI/litellm - a simple & light package to call OpenAI, Azure, Cohere, Anthropic, Replicate API Endpoints

This PR adds support for models from all the above mentioned providers (by creating a class liteLLMChatGPTBot)

Here's a sample of how it's used:

from litellm import completion

## set ENV variables
# ENV variables can be set in .env file, too. Example in .env.example
os.environ["OPENAI_API_KEY"] = "openai key"
os.environ["COHERE_API_KEY"] = "cohere key"

messages = [{ "content": "Hello, how are you?","role": "user"}]

# openai call
response = completion(model="gpt-3.5-turbo", messages=messages)

# cohere call
response = completion("command-nightly", messages)

# anthropic call
response = completion(model="claude-instant-1", messages=messages)
ishaan-jaff commented 1 year ago

cc @iuiaoin can i get a review on this

iuiaoin commented 1 year ago

@ishaan-jaff Thanks for your pull request! I got a comment for you

ishaan-jaff commented 1 year ago

@iuiaoin thanks for the review, I updated the code + added some more info on the readme

iuiaoin commented 1 year ago

@ishaan-jaff LGMT,approved. Yet seems ci failed

ishaan-jaff commented 1 year ago

@iuiaoin fixed lint errors