Tencent / TPAT

TensorRT Plugin Autogen Tool
Apache License 2.0
366 stars 42 forks source link

When will dynamic BatchSize be supported #6

Closed zhaohb closed 2 years ago

zhaohb commented 2 years ago

When will dynamic BatchSize be supported?

buptqq commented 2 years ago

Expected in late May or early June 2022, The function has been developed and we are now testing.^_^

zhaohb commented 2 years ago

Looking forward to it

DatCanCode commented 2 years ago

Can't wait anymore for dynamic BatchSize. I'm so excited about this project

buptqq commented 2 years ago

Can't wait anymore for dynamic BatchSize. I'm so excited about this project

TPAT already support dynamic batch,you can try it.