search

keldenl / gpt-llama.cpp

A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.
MIT License
594 stars 67 forks source link

Add support for ChatGPT-Discord-Bot #30

Open keldenl opened 1 year ago

keldenl commented 1 year ago

I have a PR to add base_url support: https://github.com/TheExplainthis/ChatGPT-Discord-Bot/pull/15

just needs to get merged and we'll be gucci

we're currently using this in our discord channel to power EVA, our gpt-llama.cpp expert bot

keldenl commented 1 year ago

This is the specific fork that our server uses: https://github.com/keldenl/ChatGPT-Discord-Bot-gpt-llama.cpp/tree/main-server-bot