search

Stability-AI / StableCascade

Official Code for Stable Cascade
MIT License
6.44k stars 518 forks source link

In the gradio_app/app.py load one model at a time #49

Open another-ai opened 4 months ago

another-ai commented 4 months ago

In the gradio_app/app.py: 1- load one model at a time, 2- c_dtype = torch.bfloat16 3- miss a generator=generator on def generate_prior(...) as an example see: https://github.com/another-ai/stable_cascade_easy With a nvidia rtx 3060 12 gb vram: 10 minutes vs 44 seconds

FurkanGozukara commented 3 months ago

we have amazingly optimized app which even works at 8gb gpus

https://github.com/Stability-AI/StableCascade/issues/125