search

WongSaang / chatgpt-ui

A ChatGPT web client that supports multiple users, multiple languages, and multiple database connections for persistent data storage. Provides Docker images and quick deployment scripts.
https://wongsaang.github.io/chatgpt-ui/
MIT License
1.44k stars 322 forks source link

Add support for other LLM providers #240

Open amirhmoradi opened 11 months ago

amirhmoradi commented 11 months ago

I would like to be able to use any model from OpenAI, Anthropic, Cohere, Forefront, HuggingFace, Aleph Alpha, Replicate, Banana and llama.cpp and more.

Some projects that provide this feature:

I would love to contribute if your provide me with some help on how to get started :)

molander commented 11 months ago

+1! We can start by just honoring anything with: OPENAI_API_BASE= or perhaps passing the proxy option could work: OPENAI_API_PROXY=<somewhere_else:/v1/completions>

Great project btw! Kudos and thank you for open-sourcing! Since it is opensource, it does indeed make sense to support some other models, especially opensource ones!

krrishdholakia commented 11 months ago

Hey - we might be able to help - https://github.com/BerriAI/litellm/tree/main/cookbook/proxy-server

Why use a proxy server instead of calling them directly though? With a server you'd need to run it somewhere and add an extra hop (latency)