加载Yi-6B进行lora微调报错

Tongjilibo / bert4torch

An elegent pytorch implement of transformers

https://bert4torch.readthedocs.io/

MIT License

1.23k stars 153 forks source link

Open zhadandeiren opened 7 months ago

zhadandeiren commented 7 months ago

4bit量化报错 NotImplementedError: Cannot copy out of meta tensor; no data!

代码用的examples里task_llama-2_lora.py，config已替换过Yi-6B对应的bert4torch_config了，请问这个是哪的问题？谢谢

Tongjilibo commented 7 months ago

不好意思，还没来得及处理，我这两天看一下