When medvram or lowvram is enabled. Tiled VAE will cause dtype mismatch since it only hook the main part of VAE but ignore the final projection layers.
I add a mechanism to convert the output dtype to match weight dtype to avoid below error:
RuntimeError: Input type (float) and bias type (struct c10::Half) should be the same
When medvram or lowvram is enabled. Tiled VAE will cause dtype mismatch since it only hook the main part of VAE but ignore the final projection layers.
I add a mechanism to convert the output dtype to match weight dtype to avoid below error: