maggiez0138 / Swin-Transformer-TensorRT

This project aims to explore the deployment of Swin-Transformer based on TensorRT, including the test results of FP16 and INT8.
MIT License
161 stars 29 forks source link

Where are the diagrams below obtained ? #4

Closed tensorflowt closed 1 year ago

tensorflowt commented 2 years ago

Hello! Thank you very much for your open source cod! I would like to know how the results of the analysis below are obtained. How was the QDREP file obtained here? FP16

Tanks !

maggiez0138 commented 2 years ago

Hello! Thank you very much for your open source cod! I would like to know how the results of the analysis below are obtained. How was the QDREP file obtained here? FP16

Tanks !

With nsys profile, the command may be as below.

nsys profile -o swin_tiny_patch4_window7_224_no_quant_matmul_batch16 trtexec --loadEngine=./swin_tiny_patch4_window7_224_no_quant_matmul_batch16.engine --warmUp=0 --duration=0 --iterations=50