How to include an ONNX model into onnxscript script?

[kubaraczkowski]

Hi onnnxscript people,

Onnxscript is great, I love it, thanks! I currently use it e.g. for preprocessing tasks, but would want to include the 'real' model in the flow as well. More, I would e.g. like to include 3 models as an assembly in an onnxscript.

Until now I didn't find a way (tutorial, documentation) on how to do it. It's perhaps slightly related to https://github.com/microsoft/onnxscript/issues/952 which converts the ONNX model to a script, I guess to also be able to 'merge' it with other scripts (and tweak the whole thing).

Therefore, in essence - is it possible to include a 'compiled' (proto) ONNX model as a part of an onnxscript?

Thanks!

[justinchuby]

Cc @gramalingam

[gramalingam]

Agree, it would be great to have this feature. Unfortunately, onnxscript doesn't have it yet.

Ideally, we should have a wrapper function that allows us to treat an existing ONNX model as a function, and be able to call it from an onnxscript function. Would be great to add this feature.

[kubaraczkowski]

Yes! My workaround is the following:

• write the preprocessing and postprocessing functions
• merge them with the models using onnx.compose.merge_models. Not as trivial since names often clash, so requires adding prefixes everywhere
• run using onnxruntime

Works, but misses the fantastic debuggability of onnxscript!

Looking forward to this happening :)

[titaiwangms]

Feel free to reopen if the question is not answered.