nodefluxio / vortex

A Deep Learning Model Development Framework for Computer Vision
27 stars 6 forks source link

[FEATURE] Add shape inference to onnx export, for TensorRT runtime compatibility #39

Closed alphinside closed 3 years ago

alphinside commented 4 years ago

Is your feature request related to a problem? Please describe. Yes, currently the onnx model cannot be used on onnxruntime with tensorrt backend

Describe the solution you'd like Adapt script to add shape inference derived from https://github.com/microsoft/onnxruntime/blob/master/onnxruntime/core/providers/nuphar/scripts/symbolic_shape_infer.py into our exporter