search

MiuLab / Taiwan-LLM

Traditional Mandarin LLMs for Taiwan
https://twllm.com
Apache License 2.0
1.23k stars 102 forks source link

Add support for Llama2, Palm, Cohere, Anthropic, Replicate, Azure Models - using litellm #17

Closed ishaan-jaff closed 11 months ago

ishaan-jaff commented 1 year ago

This PR adds support for 50+ models using liteLLM : https://github.com/BerriAI/litellm/

ChatLiteLLM() is integrated into langchain and allows you to call all models using the ChatOpenAI I/O interface https://python.langchain.com/docs/integrations/chat/litellm

Here's an example of how to use ChatLiteLLM()

ChatLiteLLM(model="gpt-3.5-turbo")
ChatLiteLLM(model="claude-2", temperature=0.3)
ChatLiteLLM(model="command-nightly")
ChatLiteLLM(model="replicate/llama-2-70b-chat:2c1608e18606fad2812020dc541930f2d0495ce32eee50074220b87300bc16e1")
ishaan-jaff commented 1 year ago

@adamlin120 @PichuChen Can I get a review on this PR😊? happy to add more docs / testing if this initial pr looks good

krrishdholakia commented 1 year ago

bump @adamlin120 @PichuChen

krrishdholakia commented 11 months ago

Hi @adamlin120 - what was litellm missing to be helpful here?