System Ram Problem on Google Colab

ShivamShrirao / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

https://huggingface.co/docs/diffusers

Apache License 2.0

1.89k stars 505 forks source link

System Ram Problem on Google Colab #206

Closed Sebalon80 closed 1 year ago

Sebalon80 commented 1 year ago

Describe the bug

I use a lot of class images for my models which isn't usually a problem. Lately while caching latents, colab increasingly runs out of system ram (12.7 on free colab) after 1600 ish class images cached. This is making it incredibly hard to start a training session with 80% of attempts now failing.

Reproduction

I have no reproducible code, with only a system crash when reaching max system ram

Logs

No response

System Info

ShavamShriro diffusers, google colab

Sebalon80 commented 1 year ago

The system ram leak seems to have been resolved. Its now stabilizing at 8.5gb during caching of latents.