DeSinc / SallyBot

AI Chatbot coded in Discord.net C#
MIT License
299 stars 51 forks source link

Question: Which LLM was used in this? #4

Closed xi-ve closed 1 year ago

xi-ve commented 1 year ago

Curious what LLM you used, that's all.

DeSinc commented 1 year ago

I've heard some very good things about a model called Alpaca 7B Native, it's only 4gb and has decent results. Natively trained, they say!

I also think if you get that model you can use it with Dalai Alpaca (github page has instructions for its use) and renaming that model to ggml-model-q4_0.bin and putting it in the Alpaca\models\7B folder