Closed cauyxy closed 1 year ago
if you are using llama7b-4bit-128g.pt, you should explicitly declare wbits and group_size instead of using the default params
if you are using llama7b-4bit-128g.pt, you should explicitly declare wbits and group_size instead of using the default params