nat / openplayground

An LLM playground you can run on your laptop
MIT License
6.22k stars 483 forks source link

Update Anthropic Client #101

Open krrishdholakia opened 1 year ago

krrishdholakia commented 1 year ago

Anthropic changed their python sdk - making this code line outdated.

https://github.com/nat/openplayground/blob/7f3f79035b3229aa471a9746d9af59035d5e71aa/server/lib/inference/__init__.py#L605

Would love to know if this might help - https://github.com/BerriAI/litellm

~100 lines of code, that standardizes all the llm api calls to the OpenAI call

from litellm import completion

## set ENV variables
# ENV variables can be set in .env file, too. Example in .env.example
os.environ["OPENAI_API_KEY"] = "openai key"
os.environ["ANTHROPIC_API_KEY"] = "anthropic key"

messages = [{ "content": "Hello, how are you?","role": "user"}]

# openai call
response = completion(model="gpt-3.5-turbo", messages=messages)

# anthropic call
response = completion("claude-v-2", messages)
krrishdholakia commented 1 year ago

cc: @nat