Change default opt profile behavior to be more like implicit batch

rmccorm4 / tensorrt-utils

⚡ Useful scripts when using TensorRT

Apache License 2.0

240 stars 55 forks source link

Change default opt profile behavior to be more like implicit batch #11

Open rmccorm4 opened 4 years ago

rmccorm4 commented 4 years ago

Instead of several profiles with min==opt==max, do profiles with some ranges of batch sizes to make it easier to migrate from an implicit batch workflow