Closed xi-ve closed 1 year ago
I've heard some very good things about a model called Alpaca 7B Native, it's only 4gb and has decent results. Natively trained, they say!
I also think if you get that model you can use it with Dalai Alpaca (github page has instructions for its use) and renaming that model to ggml-model-q4_0.bin and putting it in the Alpaca\models\7B folder
Curious what LLM you used, that's all.