Default db train script uses 24GB of RAM

cloneofsimo / lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

https://arxiv.org/abs/2106.09685

Apache License 2.0

6.94k stars 479 forks source link

Default db train script uses 24GB of RAM #199

Closed FrancescoSaverioZuppichini closed 1 year ago

FrancescoSaverioZuppichini commented 1 year ago

Hi 👋

Thanks a lot for the amazing work, I am trying with no success to use lora with drambooth, the dafault https://github.com/cloneofsimo/lora/blob/master/training_scripts/run_lora_db_unet_only.sh script but it consumes 24GB of RAM. I've also tried with mixed precision and xformers.

Moreover, would it be possible know why you used these parameters over the ones in the script?

Thanks a lot.

Cheers,

Fra

FrancescoSaverioZuppichini commented 1 year ago

I think I know why 😓 - I didn't install xformers! Now I am on 9.5GB