The reference to inspect.currentframe() was not being explicitly deleted, causing automatic garbage collection to not function correctly. By simply never storing a reference to it and calling the properties on the object directly, VRAM usage goes down dramatically, especially when sampling multiple latents at a time.
laksjdjf
commented
1 year ago
The reference to inspect.currentframe() was not being explicitly deleted, causing automatic garbage collection to not function correctly. By simply never storing a reference to it and calling the properties on the object directly, VRAM usage goes down dramatically, especially when sampling multiple latents at a time.