Gaute945 / Overmounting

Overmounting is a feature rich discord bot with discord's api and complex slash commands
GNU General Public License v3.0
5 stars 2 forks source link

Begin R&D for 8x7B AI integration #19

Closed Gaute945 closed 8 months ago

Gaute945 commented 8 months ago

Rationale

AI questioning is useful, but gpt cost money

Implementation Details

wraper, api, webhook maybe

Additional Information

please share details you find, this is not a one person assignment YT video about self hosting 8x7B reference repo


Note:

Andolo-64 commented 8 months ago

started research and development of how to use 8x7B AI

Gaute945 commented 8 months ago

https://github.com/jmorganca/ollama https://mistral.ai/news/mixtral-of-experts/ https://mistral.ai/ https://github.com/jmorganca/ollama#rest-api https://hub.docker.com/r/ollama/ollama