Closed ellugia closed 1 year ago
When you converted your model what max width and max height did you select. if you only selected 512x512 max then any size larger will give this error.
Try converting the models with min AND max width at 768 and min AND max height at 448 (multiples of 64!) or the other way around for portraits. You need to use the same values.
Try to work down step by step from batch size 6 or so, until it starts conversion. 4 should work, if i remember correctly.
You basically need to bake models for every resolution you want to create, if you want them optimized for maximum batch size too.
512512 + 512512 works with batch size 6, for example. I'm getting a sum of 14 it/s on my 3060 12 gb with that.
Thank you both for the answers. Honestly, I feel a bit foolish now after going over the conversion steps again and realizing it was such an obvious detail. The whole topic of AI image generation can be so dense sometimes that I kept following a tutorial word for word without paying much attention to what I was doing. Thank you!
Hi there, I've finished setting up TensorRT and converting my models to onnx -> trt and works fine at default res, but if I try anything higher than that I get these errors in my terminal: