lix19937 / tensorrt-insight

deep insight tensorrt
1 stars 0 forks source link

How to optimize slice #20

Open lix19937 opened 2 weeks ago

lix19937 commented 2 weeks ago

slice is memory bound, to optimize this we need consider other approaches.

what's the input of the slice in your real network? are they constant? If so we can first preprocess these slice and replace with constant

what's the output of the slice in your real network? If they are plugins can we adjust the plugin implementation, like calculate the address/offset inside the plugin, then we can remove the slice?