search

Tongjilibo / bert4torch

An elegent pytorch implement of transformers
https://bert4torch.readthedocs.io/
MIT License
1.25k stars 155 forks source link

加载Yi-6B进行lora微调报错 #166

Open zhadandeiren opened 8 months ago

zhadandeiren commented 8 months ago

基本信息

输出信息

4bit量化报错 NotImplementedError: Cannot copy out of meta tensor; no data!

代码用的examples里task_llama-2_lora.py，config已替换过Yi-6B对应的bert4torch_config了，请问这个是哪的问题？谢谢

Tongjilibo commented 8 months ago

不好意思，还没来得及处理，我这两天看一下