Tongjilibo / bert4torch

An elegent pytorch implement of transformers
https://bert4torch.readthedocs.io/
MIT License
1.23k stars 153 forks source link

加载Yi-6B进行lora微调报错 #166

Open zhadandeiren opened 7 months ago

zhadandeiren commented 7 months ago

基本信息

输出信息

4bit量化报错 NotImplementedError: Cannot copy out of meta tensor; no data!

代码用的examples里task_llama-2_lora.py,config已替换过Yi-6B对应的bert4torch_config了,请问这个是哪的问题?谢谢

Tongjilibo commented 7 months ago

不好意思,还没来得及处理,我这两天看一下