The program will exit or at least I didn't see an error
If you enable logging you will see errors like this "Node (/model/attn_mask_reformat/input_ids_subgraph/Reshape) Op (Reshape) [ShapeInferenceError] Cannot parse data from external tensors. Please load external data into raw data for tensor: /model/attn_mask_reformat/input_ids_subgraph/Concat_3/output_0"
Urgency
This does block performance investigations, experiments, and workarounds to attempt to work around other ONNX bugs.
Describe the issue
We were attempting to use offline optimization to optimize a model, save it, then load it using later with optimizations disabled. https://onnxruntime.ai/docs/performance/model-optimizations/graph-optimizations.html#onlineoffline-mode
However, the resulting model with basic optimizations results in an error and will not load with ShapeInferenceError
To reproduce
Urgency
This does block performance investigations, experiments, and workarounds to attempt to work around other ONNX bugs.
Platform
Windows
OS Version
11
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.18.1
ONNX Runtime API
C++
Architecture
ARM64
Execution Provider
Default CPU
Execution Provider Library Version
No response