Flux训练lora的时候loss值为nan

Akegarasu / lora-scripts

LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.

GNU Affero General Public License v3.0

4.58k stars 565 forks source link

Closed Enchner closed 2 months ago

Enchner commented 2 months ago

Flux训练lora的时候loss值为nan，修改学习率loss值也是nan，我的显卡是2080ti改22GB，不知道是不是显卡不支持，还是参数设置有问题？

Akegarasu commented 2 months ago

20系好像是用不了bf16 我记得是这样