search

jolibrain / joliGEN

Generative AI Image Toolset with GANs and Diffusion for Real-World Applications
https://www.joligen.com
Other
238 stars 31 forks source link

feat(ml): batchnorm to groupnorm in projected D and f_s unet to lower multi-gpu sync requirements #549

Closed beniz closed 11 months ago

beniz commented 12 months ago

This PR turns some BatchNorm layers into GroupNorm so that multi-gpu doesn't require many sync calls.