search

NVIDIA / Stable-Diffusion-WebUI-TensorRT

TensorRT Extension for Stable Diffusion Web UI
MIT License
1.89k stars 144 forks source link

[memory related] Can't tensorRT extension continue to train/convert if shared memory is being used? #99

Open DuckersMcQuack opened 10 months ago

DuckersMcQuack commented 10 months ago

I want to train/convert a model for a very large resolution, but whenever it starts to use shared memory as well as 24GB vram, it then fails saying there's not enough memory.

Can you please update it to continue training on said higher res? As images looks quite good at even 768x768, but i want to upscale that to 4x, or do 16:9/21:9 low res with 4x upscale, but for that, i need to train the images, as the video memory used even at 768x768 was surprisingly low with tensorRT, so i want to use my time to convert to quite large resolutions even if it uses ram.

contentis commented 10 months ago

For the 4x upscale, what low-res do you intend to use, 768?

DuckersMcQuack commented 10 months ago

For the 4x upscale, what low-res do you intend to use, 768?

768 or 960. mostly gonna be 512, 640 or 768 base height, then do whatever higher width needed for wider monitors/target res