search

Stability-AI / StableCascade

Official Code for Stable Cascade
MIT License
6.44k stars 518 forks source link

v100 cannot calculate bf16 #91

Open ganganngannn opened 4 months ago

ganganngannn commented 4 months ago

Hello, how do I modify the configuration if I want to use it on 32G v100?

divergentti commented 4 months ago

Do you mean run.py line 39 error? I checked how automatic1111 .devices.py is structured and I tried:

device = "cuda" dtype = torch.float16 . . . with torch.cuda.amp.autocast(dtype=torch.float16):

and with 32, but results are bad.

FurkanGozukara commented 3 months ago

we added fp16 support fully working : https://github.com/Stability-AI/StableCascade/issues/125