togethercomputer / OpenChatKit

Apache License 2.0
9k stars 1.01k forks source link

using ggml vicuna 13b q4 #103

Open chongy076 opened 1 year ago

chongy076 commented 1 year ago

Hi, I had tested many model , and came across a very good model. It is possible to be able to

loading or converting ggml model ggml-vicuna-13b-1.1-q4_2.bin or use huggingface eachadea/ggml-vicuna-13b-1.1 model.

in OpenChatKit?

This model have a very good accuracy and usability.

Thank you