Open shudct opened 5 months ago
Looks like it's low on video memory, what's your GPU video memory? Recommended 18GB or more
I test on RTX3090 with 24G VRAM, and I meet the same problem when use realesrgan to upsample. Controling the input image size < 512 can avoid this problem
Looks like it's low on video memory, what's your GPU video memory? Recommended 18GB or more
I use the 4090 with 24G memory. I notice that error only when I pass image < 512. The second "run_sr_fast" make the code OOM. I guess after the first "run_sr_fast" process, the onnx memory is not release, but I don't know how to solve it.
Oh, I noticed yesterday that this might be an issue. If the image resolution is below 512, it will be upsampled by 4 times to reach a resolution of 2048. This may cause a memory overflow on some very wide images.
[ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running Conv node. Name:'/conv_up2/Conv' Status Message: /onnxruntime_src/onnxruntime/core/framework/bfc_arena.cc:376 void onnxruntime::BFCArena::AllocateRawInternal(size_t, bool, onnxruntime::Stream, bool, onnxruntime::WaitNotificationFn) Available memory of 898621440 is smaller than requested bytes of 2147631360\n
I make a API demo, for the first several post, it success. however, onnx report a error later. It seems OOM. Is there any solution?