worker with gpt-llama run "OPENAI_API_HOST=http://localhost:6926 npm run dev" get error like below. the error is very long

mckaywrigley / chatbot-ui

Come join the best place on the internet to learn AI skills. Use code "chatbotui" for an extra 20% off.

https://JoinTakeoff.com

MIT License

28.65k stars 7.97k forks source link

worker with gpt-llama run "OPENAI_API_HOST=http://localhost:6926 npm run dev" get error like below. the error is very long #704

Closed GitMiaoronghua closed 9 months ago

GitMiaoronghua commented 1 year ago

upasch commented 1 year ago

You can't change the host address an expect that it work with any A.I. Normally the code is specific to use the OpenAI API endpoints. If you want to use Chatbot-UI as Interface for other LLMs, first you need to know if it provides an API, second you need to re-write the code how the API handles the communication to its model and how to format the data.