search

openchatai / OpenChat

LLMs custom-chatbots console āš”
https://open.cx
MIT License
5.17k stars 642 forks source link

Claude 2 Anthropic Support #135

Open bhctest123 opened 1 year ago

bhctest123 commented 1 year ago

It would be awesome to support claude 2! the 100k context window is amazing.

You could implement this and solve it across many LLMs: https://github.com/BerriAI/litellm

ishaan-jaff commented 1 year ago

I'm the maintainer of liteLLM - happy to make a PR and add an integrationšŸ˜Š

codebanesr commented 1 year ago

At the moment, I am unable to see Claude being utilized to facilitate completions on Langchain. Nevertheless, Langchain does provide a Chat API as detailed here: https://python.langchain.com/docs/integrations/llms/. On the other hand, Claude's support for completions is available on Llama Index, so experimenting with that option could be worthwhile.

ishaan-jaff commented 1 year ago

ChatLiteLLM() is integrated into langchain and allows you to call all models using the OpenAI I/O interface https://python.langchain.com/docs/integrations/chat/litellm