search

drizzle-mizzle / Character-Engine-Discord

(not yet very) Ultimate LLMs aggregator right in your Discord server
https://discord.gg/JtVzgJ8Znh
GNU General Public License v3.0
105 stars 47 forks source link

Suggestion for better API compatability! #31

Open Harry989 opened 3 months ago

Harry989 commented 3 months ago

Hey there! I love the look of this project and this could easily become my favourite discord bot. The only issue is API compatibility, for example I would like to use Ollama as my API service.

Integrating a library called LiteLLM (https://github.com/BerriAI/litellm) would easily allow you to interface with many llm api's and improve compatibility tenfold. I hope you could take this into consideration, many thanks for reading!

jakobdylanc commented 3 months ago

LiteLLM is python so I doubt they'd use it here

drizzle-mizzle commented 3 months ago

Yeah, python stuff has no use here, but I have a good news for you. Right now I'm rebuilding the bot from scratch with APIs' modularity prioritized, and I have two weeks vacation starting next week, finally.

Harry989 commented 3 months ago

Yeah, python stuff has no use here, but I have a good news for you. Right now I'm rebuilding the bot from scratch with APIs' modularity prioritized, and I have two weeks vacation starting next week, finally.

That’s really great to hear! I’ll make sure to star and follow this project! I’m always excited to come across cool stuff.