search

juncongmoo / pyllama

LLaMA: Open and Efficient Foundation Language Models
GNU General Public License v3.0
2.81k stars 311 forks source link

How to run llama_quant without downloading models from huggingface ? #27

Open B2F opened 1 year ago

B2F commented 1 year ago

How to run llama_quant without downloading model files from hugginface ? I tried ckpt_dir no luck I got the following error:

"the following argument are required: dataset"

sskorol commented 1 year ago

See https://github.com/juncongmoo/pyllama/issues/60#issuecomment-1500987266