Open evanweiguohua opened 1 year ago
配置如下:
enable_deepspeed = True enable_ptv2 = True enable_lora = False enable_int8 = False # qlora int8 enable_int4 = False # qlora int4
pip list |grep torch
pytorch-lightning 2.0.4 torch 2.0.1 torchaudio 2.0.2 torchmetrics 1.0.0 torchvision 0.15.2
pip uninstall deep_training pip install -U git+https://github.com/ssbuild/deep_training.git
it is bug and fixed , do upgrade can solve.
Thanks a lot. I'll try it.
PTV2将优化器设置为adam会报AttributeError: module 'torch.optim' has no attribute 'adam'的错误,adamw是好的。 Lora则没有该问题。