debug VAE memory usage in RDNA2

nod-ai / SHARK

SHARK - High Performance Machine Learning Distribution

Apache License 2.0

1.4k stars 170 forks source link

debug VAE memory usage in RDNA2 #1202

Open powderluv opened 1 year ago

powderluv commented 1 year ago

See if we can enable min-peak-memory scheduling instead of max concurrency

monorimet commented 1 year ago

min-peak-memory has no effect on memory usage on top of master with 6900xt. I'm putting in an option to disable im2col on vae for those with less than 8gb of VRAM.