About converting to .plan file format

espnet / espnet_onnx

Onnx wrapper for espnet infrernce model

MIT License

152 stars 24 forks source link

About converting to .plan file format #108

Closed hexisyztem closed 5 months ago

hexisyztem commented 5 months ago

Will the .onnx model file converted by espnet_onnx have a control flow structure? Because when there is control flow in .onnx, there will be problems converting to .plan for tensorRT

Masao-Someki commented 5 months ago

I'm sorry, but I'm not entirely sure about the details. We're simply using the torch.onn.export function for model exportation. Therefore, if the ONNX file generated from this function includes control flow, then our model will also have them.

https://github.com/espnet/espnet_onnx/blob/5828178cbe1375f397e011c1851e0ea9a9aeff20/espnet_onnx/export/asr/export_asr.py#L246-L255

hexisyztem commented 5 months ago

OK, thanks