openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
7.12k stars 2.23k forks source link

[Bug]: OpenVINO does not support the following ONNX operations: DeformConv #24635

Open Mitix-EPI opened 4 months ago

Mitix-EPI commented 4 months ago

OpenVINO Version

openvino==2024.1.0

Operating System

Ubuntu 18.04 (LTS)

Device used for inference

CPU

Framework

ONNX

Model used

No response

Issue description

Openvino supports ONNX opset 20. Howerver, openvino does not support DeformConv 19

image

Step-by-step reproduction

import onnx
import onnx.helper as helper
import numpy as np
import openvino as ov

if __name__ == '__main__':
    input = helper.make_tensor_value_info(name='input', elem_type=onnx.TensorProto.FLOAT, shape=[1, 64, 512, 960])
    output = helper.make_tensor_value_info(name='output', elem_type=onnx.TensorProto.FLOAT, shape=[1, 64, 512, 960])
    weight = helper.make_tensor(name='weight', data_type=onnx.TensorProto.FLOAT, dims=[64,64,3,3], vals=np.random.randn(64,64,3,3))
    offsets = helper.make_tensor_value_info(name='offsets', elem_type=onnx.TensorProto.FLOAT, shape=[1, 18, 512, 960])
    node = helper.make_node(name='dcn', op_type='DeformConv', inputs=['input', 'weight', 'offsets'], outputs=['output'], kernel_shape=[3, 3], strides=[1, 1],
                            group=1, pads=[0, 0, 0, 0])
    graph = helper.make_graph(name='graph', nodes=[node], inputs=[input, offsets], outputs=[output], initializer=[weight])
    model = helper.make_model(graph)
    onnx.checker.check_model(model)
    print(model)
    onnx.save_model(model, 'create_dcn.onnx')

    ov.compile_model("create_dcn.onnx")

Relevant log output

Trace: `OpenVINO does not support the following ONNX operations: DeformConv`

Issue submission checklist

rkazants commented 4 months ago

@gkrivor, @mlukasze, GFI? We have DeformableConv in our opset.

Best regards, Roman

mlukasze commented 4 months ago

@gkrivor, @mlukasze, GFI? We have DeformableConv in our opset.

Best regards, Roman

good idea

mlukasze commented 4 months ago

GFI has been created https://github.com/openvinotoolkit/openvino/issues/24649