unsupported layer type "ScatterNDUpdate" despite the said in doc

mosdav commented 2 years ago

System information (version)

OpenVINO => 2022.2
Operating System / Platform => Windows 64 Bit
Compiler => Visual Studio 2019
Problem classification: Model Conversion

Detailed description

According to the doc, the op ScatterND is supported.

Yet, I'm getting this error in the model compiler

d:\users\modav\Work\openvino\bin\intel64\Release>compile_tool.exe -m "D:\users\modav\Work\2021.4\scratch\deployment_tools\model_optimizer\retina_new_static-simp-nms.xml" -VPU_NUMBER_OF_SHAVES 4 -VPU_NUMBER_OF_CMX_SLICES 4 -o kaki.onnx -iop "input_0:U8, final_scores:FP32, final_boxes:FP32, final_is_frontal_scores:FP32, final_face_boxes:FP32" -d MYRIAD  -ov_api_1_0
OpenVINO Runtime version ......... 2022.2.0
Build ........... 2022.2.0-000-af16ea1d79a-HEAD
Network inputs:
input_0 : U8 / NCHW
Network outputs:
final_boxes : FP32 / NC
final_face_boxes : FP32 / NC
final_is_frontal_scores : FP32 / NC
final_scores : FP32 / NC
slice_confidence/Split.0 : FP16 / CHW
[ GENERAL_ERROR ]
D:\users\modav\Work\openvino\src\plugins\intel_myriad\graph_transformer\src\frontend\frontend.cpp:594 Failed to compile layer "ScatterND_243": unsupported layer type "ScatterNDUpdate"

Steps to reproduce

Issue submission checklist

[x] I report the issue, it's not a question
[x] I checked the problem with documentation, FAQ, open issues, Stack Overflow, etc and have not found solution
[x] There is reproducer code and related data files: images, videos, models, etc.
- can share under NDA

ilya-lavrenov commented 2 years ago

According to the doc, the op ScatterND is supported.

It's supported by OpenVINO, but OpenVINO has multiple execution devices and not all operators are supported by all devices. Please, check https://docs.openvino.ai/2022.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html#supported-layers

mosdav commented 2 years ago

According to the doc, the op ScatterND is supported.

It's supported by OpenVINO, but OpenVINO has multiple execution devices and not all operators are supported by all devices. Please, check https://docs.openvino.ai/2022.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html#supported-layers

@ilya-lavrenov according to the link the op DOES being supported under MYRIAD/VPU (-d MYRIAD is the device used in the CLI above). So either doc should be changed? or this is a bug?

avitial commented 2 years ago

@mosdav Does the IR model with ScatterNDUpdate run with benchmark_app? Afaik ScatterND is not supported by VPU plugins, so documentation may need to be updated to reflect this. Let me confirm and get back to you.

In case you are using PyTorch check this out and see if its relevant to your model https://github.com/openvinotoolkit/openvino/issues/3882#issuecomment-834382914.

mosdav commented 2 years ago

@avitial thx for taking a look

Does the IR model with ScatterNDUpdate run with benchmark_app?

Nope, failed w/ the very same error message from the model compiler tool.

modav@modav-nano:~/Work/openvino/bin/aarch64/Release$ ./benchmark_app_legacy -m /tmp/ir/retina_new_static-simp-nms.xml -d  MYRIAD
[Step 1/11] Parsing and validating input arguments
[ INFO ] Parsing input parameters
[Step 2/11] Loading Inference Engine
[ INFO ] InferenceEngine:
        IE version ......... 2022.2.0
        Build ........... 2022.2.0-000-af16ea1d79a-HEAD
[ INFO ] Device info:
        MYRIAD
        openvino_intel_myriad_plugin version ......... 2022.2.0
        Build ........... 2022.2.0-000-af16ea1d79a-HEAD

[Step 3/11] Setting device configuration
[ WARNING ] -nstreams default value is determined automatically for MYRIAD device. Although the automatic selection usually provides a reasonable performance, but it still may be non-optimal for some cases, for more information look at README.
[Step 4/11] Reading network files
[ INFO ] Loading network files
[ INFO ] Read network took 108.99 ms
[Step 5/11] Resizing network to match image sizes and given batch
[ INFO ] Network batch size: 1
[Step 6/11] Configuring input of the model
Network inputs:
    input_0 : U8 / NCHW
Network outputs:
    final_boxes : FP32 / NC
    final_face_boxes : FP32 / NC
    final_is_frontal_scores : FP32 / NC
    final_scores : FP32 / NC
    slice_confidence/Split.0 : FP32 / CHW
[Step 7/11] Loading the model to the device
[ ERROR ] [ GENERAL_ERROR ]
/home/modav/Work/openvino/src/plugins/intel_myriad/graph_transformer/src/frontend/frontend.cpp:594 Failed to compile layer "ScatterND_243": unsupported layer type "ScatterNDUpdate"
modav@modav-nano:~/Work/openvino/bin/aarch64/Release$

Will wait for your confirmation if we face a doc hiccup

mosdav commented 2 years ago

@avitial bumping this thread

andrei-kochin commented 2 years ago

@mosdav looks like doc you've mentioned tell about "ScatterUpdate" not "ScatterND" or "ScatterNDUpdate" so seems like no discrepancy with behavior or maybe I misunderstand something.

Please comment. Thank you!

avitial commented 2 years ago

@mosdav unfortunately ScatterNDUpdate is not supported by MyriadX plugin.

As highlighted by Andrei the doc shared is correct, ScatterUpdate (not ScatterNDUpdate) is supported by VPU plugins.

avitial commented 1 year ago

Closing this. Feel free to reopen and ask additional questions related to this topic.

IkrameBeggar commented 3 months ago

@mosdav unfortunately ScatterNDUpdate is not supported by MyriadX plugin.

As highlighted by Andrei the doc shared is correct, ScatterUpdate (not ScatterNDUpdate) is supported by VPU plugins.

Hello, I'm facing the same error when I try to run my model on the NCS2 which is the following:

OpenVINO version: 2022.3.1

Traceback (most recent call last): File "test_spnv2_myriad.py", line 49, in compiled_model = ie_core.compile_model(model=model, device_name="MYRIAD") File "/opt/intel/openvino_2022.3.1/python/python3.8/openvino/runtime/ie_api.py", line 399, in compile_model super().compile_model(model, device_name, {} if config is None else config), RuntimeError: [ GENERAL_ERROR ] /home/jenkins/agent/workspace/private-ci/ie/build-linux-ubuntu20/b/repos/openvino/src/plugins/intel_myriad/graph_transformer/src/frontend/frontend.cpp:596 Failed to compile layer "ScatterND_8672": unsupported layer type "ScatterNDUpdate"

Can you help me with this please?

openvinotoolkit / openvino