search

microsoft / Cream

This is a collection of our NAS and Vision Transformer work.
MIT License
1.62k stars 220 forks source link

TRT inference failed : EfficientViT_M5 #171

Closed shensheng272 closed 1 year ago

shensheng272 commented 1 year ago

Error: [05/16/2023-11:16:54] [E] Error[1]: [convolutionRunner.cpp::executeConv::465] Error Code 1: Cudnn (CUDNN_STATUS_NOT_SUPPORTED) [05/16/2023-11:16:54] [E] Error occurred during inference

how to reproduce download onnx from https://github.com/xinyuliu-jeffrey/EfficientViT_Model_Zoo/releases/download/v1.0/EfficientViT_M5.onnx with TensorRT version: 8.4.3 trtexec --explicitBatch --onnx=EfficientViT_M5.onnx --workspace=1024 --saveEngine=EfficientViT_M5.trt --fp16 --inputIOFormats=fp16:chw --outputIOFormats=fp16:chw trtexec --loadEngine=EfficientViT_M5.trt --fp16 --avgRuns=1000 --workspace=1024

shensheng272 commented 1 year ago

remove --inputIOFormats=fp16:chw --outputIOFormats=fp16:chw fix the error