Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案,结构参考alpaca
https://github.com/Facico/Chinese-Vicuna
Apache License 2.0
4.14k stars 421 forks source link

TypeError: dispatch_model() got an unexpected keyword argument 'offload_index' #18

Closed alisyzhu closed 1 year ago

alisyzhu commented 1 year ago

base_model='llama-7b-hf', 2 GPU, but failed.

LZY-the-boys commented 1 year ago

It seems like the errors from internal packages (Maybe Accelerate?) . May you try to update these package to newest first ?

pip install git+https://github.com/huggingface/transformers.git
pip install git+https://github.com/huggingface/peft.git
pip install -U accelerate

Also please attach the full traceback for us to recognize the exact error.

alisyzhu commented 1 year ago

yes,thank you ~