Train with fp16 - Githubissues

Stability-AI / stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

MIT License

38.83k stars 5.01k forks source link

Train with fp16 #279

Open yjhong89 opened 1 year ago

yjhong89 commented 1 year ago

Hi, Thanks for sharing great work!

I am trying to fine-tune stable-diffusion model v2 with use_fp16=True option. (I installed xformers) But it still RuntimeError occurs like below

I think there needs some codes converting model weight to fp16 but there isn't any convertion or autocast
https://github.com/Stability-AI/stablediffusion/blob/cf1d67a6fd5ea1aa600c4df58e5b47da45f6bdbf/ldm/modules/diffusionmodules/openaimodel.py#L23
Is it possible training stable diffusion with fp16 ??

xiao2mo commented 7 months ago

same problem here