Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案,结构参考alpaca
https://github.com/Facico/Chinese-Vicuna
Apache License 2.0
4.14k stars 422 forks source link

关于 finetune_others_continue.sh 的参数问题 #200

Closed Lufffya closed 1 year ago

Lufffya commented 1 year ago

我注意到 finetune_others_continue 脚本里面有一个 --lora_remote_checkpoint $lora_remote_checkpoint 的参数

1,这个参数有什么作用? 2,和 --resume_from_checkpoint $lora_checkpoint 有什么区别?

最后我参考了 Chinese-Vicuna-medical 没有使用 --lora_remote_checkpoint

FURYFOR commented 1 year ago

--lora_remote_checkpoint 是huggingface上远程checkpoint,--resume_from_checkpoint是加载本地checkpoint,应该是二者选其一,若使用本地checkpoint可在finetune_others_continue.sh删除--lora_remote_checkpoint $lora_remote_checkpoint