LayerNormalization operator is not in onnx domain

[tianleiwu]

Describe the bug

Onnxruntime defined some operators (like LayerNormalization, SimplifiedLayerNormalization etc) in onnx domain: https://github.com/microsoft/onnxruntime/blob/8d737f977056444a307f1b7f0bcd402fba62d790/onnxruntime/contrib_ops/cuda/cuda_contrib_kernels.cc#L70-L75

However, they are not standard onnx operators as listed in (https://github.com/onnx/onnx/blob/master/docs/Operators.md).

That causes some issue. For example, symbolic shape inference outputs warning: Warning: Unsupported operator LayerNormalization. No schema registered for this operator.

Urgency If there are particular important use cases blocked by this or strict project-related timelines, please share more information and dates. If there are no hard deadlines, please specify none.

None

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
• ONNX Runtime installed from (source or binary):
• ONNX Runtime version:
• Python version:
• Visual Studio version (if applicable):
• GCC/Compiler version (if compiling from source):
• CUDA/cuDNN version:
• GPU model and memory:

To Reproduce

• Describe steps/code to reproduce the behavior.
• Attach the ONNX model to the issue (where applicable) to expedite investigation.

Expected behavior How about change to MS domain, and add some logic for backward compatible (like rewrite the domain for those operator during loading models).

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here. If the issue is about a particular model, please share the model details as well to facilitate debugging.

[ytaous]

@yufenglee , @SherlockNoMad , @ashbhandare - change it to "kMSDomain" ?

[SherlockNoMad]

@yufenglee , @SherlockNoMad , @ashbhandare - change it to "kMSDomain" ?

agree. let's fix this.

[tianleiwu]

I updated symbolic shape inference (in https://github.com/microsoft/onnxruntime/pull/7606) so that we will not call onnx shape inference on LayerNormalization node.

It is not urgent right now. Let's add this to back log.

[ytaous]

@tianleiwu - backlog created for backend team, close this for now with your workaround. We can sync offline on the progress. Thanks for reporting it.

[kaiyux]

Did you change the domain now? Seems like the domain is still kOnnxDomain in here & here.
And I still gets Fatal error: LayerNormalization is not a registered function/op even though opset com.microsoft is imported.

[tianleiwu]

Not fixed yet.

[anpin]

is there a workaround?