Enable Discord bot to interact with OpenAI API

bifrostlab / llm-assistant

Multifunctional LLM Assistant for Discord

8 stars 6 forks source link

Enable Discord bot to interact with OpenAI API #25

Closed rodonguyen closed 7 months ago

rodonguyen commented 8 months ago

Integrate OpenAI bot (via its API) to the current discord bot
Also utilise LiteLM để act as a scheduler, tránh tình trạng response lâu (await ctx.defer()) hay nhiều requests làm đơ bot

hungdtrn commented 8 months ago

I will write a test to test the ability of litellm in handling multiple request

nqngo commented 7 months ago

I don't think we put a high priority on using OpenAI to response to the users. Remember OpenAI resource is not something we can completely use for free and is at the good will of the donated key.

It is fine to keep the response delayed and use the local LLM model as I can try getting us more funding on that aspect to improve the model responsiveness. I do not have that luxury with OpenAI models.