Open TheMattBin opened 3 weeks ago
I also tested with DETR (onnx with cuda) which is supported by optimum.cli, also got the same issue.
optimum-cli export onnx -m facebook/detr-resnet-50 --task 'object-detection' --framework 'pt' detr_gpu --device cuda
System Info
Who can help?
@JingyaHuang @echarlaix
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
Hi, I'm running my customized onnx model with optimum with CUDA using
ORTModelForCustomTasks
. I can run my model with both CPU and Intel-Openvino. However, when I run the script below, it shows errorsAttributeError: 'ORTModelForCustomTasks' object has no attribute 'inputs_names'
which I assumed related tooptimum/onnxruntime/io_binding/io_binding_helper.py:160
. It would be helpful if you can provide some hints with this issue.Expected behavior
I would expect the code to be run and provide similar detection output like running on onnx model with CPU.