model convert tensorRT - Githubissues

qqlu / Entity

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

Other

704 stars 58 forks source link

model convert tensorRT #39

Open Winnie202 opened 8 months ago

Winnie202 commented 8 months ago

Thanks for your work。Can the Cropformer-Swin model be converted to tensorRT? How can I improve the speed of predict? I am currently testing 50 images using NVIDIA GeForce RTX 3090, which takes 15 minutes.

qqlu commented 8 months ago

We will try to convert the CropFormer to the TensorRT. However, I am not sure costing 15 minutes for 50 images is the normal speed. Is your image very large?

Winnie202 commented 8 months ago

Hi

We will try to convert the CropFormer to the TensorRT. However, I am not sure costing 15 minutes for 50 images is the normal speed. Is your image very large?

Lu

yes, the resolution 2048*3072. In addition, may I ask when the conversion to tensorrt can be realized