Would it be possible to include a toggle to build a dynamic shapes engine instead of static as people like me who vary their input resolutions a lot will benefit much more from not having to build engine over the ~5% speed decrease in inference (referring to vs-mlrt wiki benchmarks)
Would it be possible to include a toggle to build a dynamic shapes engine instead of static as people like me who vary their input resolutions a lot will benefit much more from not having to build engine over the ~5% speed decrease in inference (referring to vs-mlrt wiki benchmarks)
Many thanks!