openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
6.83k stars 2.18k forks source link

[Bug]: predictor compile on gpu failed #26246

Open ziyanxzy opened 2 weeks ago

ziyanxzy commented 2 weeks ago

OpenVINO Version

2024.4.0-16311-2c8fd1e6e97

Operating System

Windows System

Device used for inference

GPU

Framework

None

Model used

paraformer (predictor)

Issue description

ov_predictor=ov.compile_model("predictor_static.xml","CPU") predictor_outs=ov_predictor(example_inputs) predictor_static.zip

CPU run successful! but GPU run failed.

Step-by-step reproduction

No response

Relevant log output

No response

Issue submission checklist

isanghao commented 2 weeks ago

Could you post more detailed information? Screenshot of failure and the model including weight(if possible) would be helpful.

ziyanxzy commented 2 weeks ago

Could you post more detailed information? Screenshot of failure and the model including weight(if possible) would be helpful.

i provide the xml model, and you can compile this model with GPU. you can get image and because of convolution ops.

isanghao commented 2 weeks ago

In order to run the model, we need .bin file as well. xml file alone does not work.

avitial commented 3 days ago

@ziyanxzy do you have an update for us? If possible please provide the model's .bin file.