When will dynamic BatchSize be supported

Tencent / TPAT

TensorRT Plugin Autogen Tool

Apache License 2.0

366 stars 42 forks source link

Closed zhaohb closed 2 years ago

zhaohb commented 2 years ago

When will dynamic BatchSize be supported？

buptqq commented 2 years ago

Expected in late May or early June 2022, The function has been developed and we are now testing.^_^

zhaohb commented 2 years ago

Looking forward to it

DatCanCode commented 2 years ago

Can't wait anymore for dynamic BatchSize. I'm so excited about this project

buptqq commented 2 years ago

Can't wait anymore for dynamic BatchSize. I'm so excited about this project

TPAT already support dynamic batch，you can try it.