Support for dynamic shape ?

Tencent / TPAT

TensorRT Plugin Autogen Tool

Apache License 2.0

367 stars 42 forks source link

Closed sleepwalker2017 closed 1 year ago

sleepwalker2017 commented 1 year ago

Does it support Dynamic shape kernel generation?

zhuwenxi commented 1 year ago

Currently we do NOT have a full dynamic shape generation support, since TVM haven't support it yet, sorry.

Nevertheless, If you want dynamic batch size kernel generation, TPAT already support it. Feel free to have a try.

sleepwalker2017 commented 1 year ago

thank you