search

HighCWu / control-lora-v3

ControlLoRA Version 3: LoRA Is All You Need to Control the Spatial Information of Stable Diffusion.
MIT License
41 stars 0 forks source link

about the nan problem #2

Closed gaojuhao2002 closed 3 months ago

gaojuhao2002 commented 3 months ago

debug的时候发现，vae好像不能正确编码图像，encode的latent结果是nan，导致训练的时候loss为nan

HighCWu commented 3 months ago

可以使用bf16混合精度

gaojuhao2002 commented 3 months ago

可以使用bf16混合精度

非常感谢您的回复，修改为b16后，xl的训练可以正常进行了