privateGPT library offer the ability to run a open source LLM model locally and on your own documents. This LLM framework is able to run GPT4ALL and Llama based models and also supporting a local vector DB to allow queries to have personal context data for the replies.
The idea behind a possible integration with discord is that it allow the creation of specialized bot that have knowledge on a specific domain that can be accessed by a discord community
This project is developing fast, but might not still be ready for direct integration. by the look of the PR and dissections, GPU support and UI will be added shortly
I think future integration with library of this kind, can open a new world of opportunities for community discord AI bots.
privateGPT library offer the ability to run a open source LLM model locally and on your own documents. This LLM framework is able to run GPT4ALL and Llama based models and also supporting a local vector DB to allow queries to have personal context data for the replies.
The idea behind a possible integration with discord is that it allow the creation of specialized bot that have knowledge on a specific domain that can be accessed by a discord community
This project is developing fast, but might not still be ready for direct integration. by the look of the PR and dissections, GPU support and UI will be added shortly
I think future integration with library of this kind, can open a new world of opportunities for community discord AI bots.