Getting an OOM on decode

[Mindspherical]

Thanks for creating this node so quickly!

I'm running on an A100 with 40gb VRAM, but seeing this:

This is with normal SVD. SVD_xt would OOM before even running inference.

[Mindspherical]

Fixed this by lowering the t_value of the decoder to 1.

[thecooltechguy]

got it, thank you!