search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.55k stars 2.91k forks source link

Unsupported OpenVINO version on Windows when shortcut is used #5435

Open danielecazzari opened 4 years ago

danielecazzari commented 4 years ago

Describe the bug If on Windows the OpenVino environment batch it's called using shortcut the cmake fails with: Unsupported OpenVINO version message. This is the command that does not work: call "C:\Program Files (x86)\IntelSWTools\openvino\bin\setupvars.bat" If as workarround the full path it's given the cmake command succeeds: e.g. call "C:\Program Files (x86)\IntelSWTools\openvino_2020.4.287\bin\setupvars.bat"

The reason for this behavior it's due to the logic inside CMakeLists.txt to check for OpenVino version (line 930-940) that relies on version to be passed within the INTEL_OPENVINO_DIR env variable. In the first scenario on windows that variable does not contains any version name and this cause the faillure.

I wonder if there is any better way to check for the OpenVino Version?

jywu-msft commented 4 years ago

if I'm understanding correctly, you're saying the batch file sets the INTEL_OPENVINO_DIR depending on where the script is called from? can you confirm my understanding? I don't currently have access to look at that batch file, but I recall that wasn't the behavior on Linux for the corresponding setupvars.sh script.

Re: better way to check for OpenVINO version, maybe another way is to check version file under inference_engine ?

Adding folks from Intel for further comments/insight into the behavior Daniele observed on Windows OpenVINO. +@smkarlap , @suryasidd

danielecazzari commented 4 years ago

Hi George, sorry I missed your question. The issue that windows shortcut are not transparent. So if you call the "openvino" path (that is a link to the latest version) the cmake script will receive "openvino" as path and not the linked directory that is openvino_2020.4.287 in this case. Hope I explained myself better.

Regards,

Daniele

jywu-msft commented 4 years ago

okay. it's clear to me now. it looks to me like they changed the setupvars script. it used to be that the INSTALLDIR was hardcoded and would contain the version in the path. now it's relative to BASE_DIR which is problematic if you run the script from a shortcut or path with symlink (on Linux)

+@smkarlap, @suryasidd the logic to detect openvino version should be updated. can we use my suggestion above to check the version file under inference_engine directory?

smkarlap commented 4 years ago

Yeah, We have recently seen another instance where the using the 'openvino' symlink has caused this issue. We will look into modifying logic to determine OpenVINO version.

xonobo commented 3 years ago

On ubuntu 18.04 similar failure. Dont know the shortcut on windows but this is the official build step to run smoothly.

python3
Python 3.6.9 (default, Oct  8 2020, 12:12:24) 
[GCC 8.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import openvino
>>> from openvino import in
in      input(  int(    
>>> from openvino import inference_engine as ie
>>> ie.get_version()
'2.1.2021.1.0-1237-bece22ac675-releases/2021/1'
>>> 
./build.sh --config RelWithDebInfo --use_openvino GPU_FP16 
2020-11-03 15:34:48,529 Build [DEBUG] - Defaulting to running update, build [and test for native builds].
2020-11-03 15:34:48,529 Build [INFO] - Build started
2020-11-03 15:34:48,529 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime'
['git', 'submodule', 'sync', '--recursive']
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/eigen'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/re2'
Synchronizing submodule url for 'cmake/external/SafeInt/safeint'
Synchronizing submodule url for 'cmake/external/cub'
Synchronizing submodule url for 'cmake/external/cxxopts'
Synchronizing submodule url for 'cmake/external/date'
Synchronizing submodule url for 'cmake/external/eigen'
Synchronizing submodule url for 'cmake/external/flatbuffers'
Synchronizing submodule url for 'cmake/external/gemmlowp'
Synchronizing submodule url for 'cmake/external/googletest'
Synchronizing submodule url for 'cmake/external/horovod'
Synchronizing submodule url for 'cmake/external/horovod/third_party/HTTPRequest'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/assert'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/config'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/core'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/detail'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/iterator'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/lockfree'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/mpl'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/parameter'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/predef'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/preprocessor'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/static_assert'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/type_traits'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/utility'
Synchronizing submodule url for 'cmake/external/horovod/third_party/eigen'
Synchronizing submodule url for 'cmake/external/horovod/third_party/flatbuffers'
Synchronizing submodule url for 'cmake/external/horovod/third_party/gloo'
Synchronizing submodule url for 'cmake/external/horovod/third_party/lbfgs'
Synchronizing submodule url for 'cmake/external/json'
Synchronizing submodule url for 'cmake/external/libprotobuf-mutator'
Synchronizing submodule url for 'cmake/external/mimalloc'
Synchronizing submodule url for 'cmake/external/nsync'
Synchronizing submodule url for 'cmake/external/onnx'
Synchronizing submodule url for 'cmake/external/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx/third_party/pybind11/tools/clang'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang'
Synchronizing submodule url for 'cmake/external/protobuf'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/googletest'
Synchronizing submodule url for 'cmake/external/re2'
Synchronizing submodule url for 'cmake/external/tensorboard'
Synchronizing submodule url for 'cmake/external/tvm'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/HalideIR'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dlpack'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dmlc-core'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/rang'
Synchronizing submodule url for 'cmake/external/wil'
Synchronizing submodule url for 'server/external/spdlog'
2020-11-03 15:34:48,718 Build [DEBUG] - Subprocess completed. Return code=0
2020-11-03 15:34:48,718 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime'
['git', 'submodule', 'update', '--init', '--recursive']
2020-11-03 15:34:50,157 Build [DEBUG] - Subprocess completed. Return code=0
2020-11-03 15:34:50,158 Build [INFO] - Generating CMake build tree
2020-11-03 15:34:50,159 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo'
['/usr/local/bin/cmake', '/home/xonobo/github/onnxruntime/cmake', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_BUILD_WINML_TESTS=ON', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-Donnxruntime_DEV_MODE=ON', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-Donnxruntime_USE_CUDA=OFF', '-Donnxruntime_CUDNN_HOME=', '-Donnxruntime_USE_FEATURIZERS=OFF', '-Donnxruntime_CUDA_HOME=', '-Donnxruntime_USE_JEMALLOC=OFF', '-Donnxruntime_USE_MIMALLOC_STL_ALLOCATOR=OFF', '-Donnxruntime_USE_MIMALLOC_ARENA_ALLOCATOR=OFF', '-Donnxruntime_ENABLE_PYTHON=OFF', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_SHARED_LIB=OFF', '-Donnxruntime_USE_EIGEN_FOR_BLAS=ON', '-Donnxruntime_USE_OPENBLAS=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_USE_MKLML=OFF', '-Donnxruntime_USE_NGRAPH=OFF', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_OPENMP=OFF', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_NUPHAR=OFF', '-Donnxruntime_USE_TENSORRT=OFF', '-Donnxruntime_TENSORRT_HOME=', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_MIGRAPHX_HOME=', '-Donnxruntime_CROSS_COMPILING=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_DISABLE_ORT_FORMAT_LOAD=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_MSVC_STATIC_RUNTIME=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ARMNN=OFF', '-Donnxruntime_ARMNN_RELU_USE_CPU=ON', '-Donnxruntime_ARMNN_BN_USE_CPU=ON', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_USE_HOROVOD=OFF', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_OPENVINO=ON', '-Donnxruntime_USE_OPENVINO_MYRIAD=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP16=ON', '-Donnxruntime_USE_OPENVINO_CPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_VAD_M=OFF', '-Donnxruntime_USE_OPENVINO_VAD_F=OFF', '-Donnxruntime_USE_OPENVINO_BINARY=ON', '-Donnxruntime_USE_FULL_PROTOBUF=ON', '-DProtobuf_USE_STATIC_LIBS=ON', '-Donnxruntime_PYBIND_EXPORT_OPSCHEMA=OFF', '-Donnxruntime_ENABLE_MEMLEAK_CHECKER=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo']
Use gtest from submodule
Use protobuf from submodule
-- 
-- 3.11.3.0
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-ml.proto
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-operators-ml.proto
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-data.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.18.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/c++
--   C++ compiler version  : 7.5.0
--   CXX flags             :  -Wnon-virtual-dtor
--   Build type            : RelWithDebInfo
--   Compile definitions   : ENABLE_ORT_FORMAT_LOAD;EIGEN_MPL2_ONLY;USE_EIGEN_FOR_BLAS
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /usr/local
--   CMAKE_MODULE_PATH     : /home/xonobo/github/onnxruntime/cmake/external
-- 
--   ONNX version          : 1.7.0
--   ONNX NAMESPACE        : onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
CMake Error at CMakeLists.txt:940 (message):
  Unsupported OpenVINO version:

-- Configuring incomplete, errors occurred!
See also "/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/CMakeFiles/CMakeOutput.log".
See also "/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/CMakeFiles/CMakeError.log".
Traceback (most recent call last):
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 1794, in <module>
    sys.exit(main())
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 1723, in main
    args, cmake_extra_args)
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 895, in generate_build_tree
    cwd=config_build_dir)
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 434, in run_subprocess
    env=my_env, shell=shell)
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/usr/local/bin/cmake', '/home/xonobo/github/onnxruntime/cmake', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_BUILD_WINML_TESTS=ON', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-Donnxruntime_DEV_MODE=ON', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-Donnxruntime_USE_CUDA=OFF', '-Donnxruntime_CUDNN_HOME=', '-Donnxruntime_USE_FEATURIZERS=OFF', '-Donnxruntime_CUDA_HOME=', '-Donnxruntime_USE_JEMALLOC=OFF', '-Donnxruntime_USE_MIMALLOC_STL_ALLOCATOR=OFF', '-Donnxruntime_USE_MIMALLOC_ARENA_ALLOCATOR=OFF', '-Donnxruntime_ENABLE_PYTHON=OFF', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_SHARED_LIB=OFF', '-Donnxruntime_USE_EIGEN_FOR_BLAS=ON', '-Donnxruntime_USE_OPENBLAS=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_USE_MKLML=OFF', '-Donnxruntime_USE_NGRAPH=OFF', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_OPENMP=OFF', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_NUPHAR=OFF', '-Donnxruntime_USE_TENSORRT=OFF', '-Donnxruntime_TENSORRT_HOME=', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_MIGRAPHX_HOME=', '-Donnxruntime_CROSS_COMPILING=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_DISABLE_ORT_FORMAT_LOAD=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_MSVC_STATIC_RUNTIME=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ARMNN=OFF', '-Donnxruntime_ARMNN_RELU_USE_CPU=ON', '-Donnxruntime_ARMNN_BN_USE_CPU=ON', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_USE_HOROVOD=OFF', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_OPENVINO=ON', '-Donnxruntime_USE_OPENVINO_MYRIAD=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP16=ON', '-Donnxruntime_USE_OPENVINO_CPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_VAD_M=OFF', '-Donnxruntime_USE_OPENVINO_VAD_F=OFF', '-Donnxruntime_USE_OPENVINO_BINARY=ON', '-Donnxruntime_USE_FULL_PROTOBUF=ON', '-DProtobuf_USE_STATIC_LIBS=ON', '-Donnxruntime_PYBIND_EXPORT_OPSCHEMA=OFF', '-Donnxruntime_ENABLE_MEMLEAK_CHECKER=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo']' returned non-zero exit status 1.
jywu-msft commented 3 years ago

On ubuntu 18.04 similar failure. Dont know the shortcut on windows but this is the official build step to run smoothly.

python3
Python 3.6.9 (default, Oct  8 2020, 12:12:24) 
[GCC 8.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import openvino
>>> from openvino import in
in      input(  int(    
>>> from openvino import inference_engine as ie
>>> ie.get_version()
'2.1.2021.1.0-1237-bece22ac675-releases/2021/1'
>>> 
./build.sh --config RelWithDebInfo --use_openvino GPU_FP16 
2020-11-03 15:34:48,529 Build [DEBUG] - Defaulting to running update, build [and test for native builds].
2020-11-03 15:34:48,529 Build [INFO] - Build started
2020-11-03 15:34:48,529 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime'
['git', 'submodule', 'sync', '--recursive']
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/eigen'
Synchronizing submodule url for 'cmake/external/FeaturizersLibrary/src/3rdParty/re2'
Synchronizing submodule url for 'cmake/external/SafeInt/safeint'
Synchronizing submodule url for 'cmake/external/cub'
Synchronizing submodule url for 'cmake/external/cxxopts'
Synchronizing submodule url for 'cmake/external/date'
Synchronizing submodule url for 'cmake/external/eigen'
Synchronizing submodule url for 'cmake/external/flatbuffers'
Synchronizing submodule url for 'cmake/external/gemmlowp'
Synchronizing submodule url for 'cmake/external/googletest'
Synchronizing submodule url for 'cmake/external/horovod'
Synchronizing submodule url for 'cmake/external/horovod/third_party/HTTPRequest'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/assert'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/config'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/core'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/detail'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/iterator'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/lockfree'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/mpl'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/parameter'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/predef'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/preprocessor'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/static_assert'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/type_traits'
Synchronizing submodule url for 'cmake/external/horovod/third_party/boost/utility'
Synchronizing submodule url for 'cmake/external/horovod/third_party/eigen'
Synchronizing submodule url for 'cmake/external/horovod/third_party/flatbuffers'
Synchronizing submodule url for 'cmake/external/horovod/third_party/gloo'
Synchronizing submodule url for 'cmake/external/horovod/third_party/lbfgs'
Synchronizing submodule url for 'cmake/external/json'
Synchronizing submodule url for 'cmake/external/libprotobuf-mutator'
Synchronizing submodule url for 'cmake/external/mimalloc'
Synchronizing submodule url for 'cmake/external/nsync'
Synchronizing submodule url for 'cmake/external/onnx'
Synchronizing submodule url for 'cmake/external/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx/third_party/pybind11/tools/clang'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11'
Synchronizing submodule url for 'cmake/external/onnx-tensorrt/third_party/onnx/third_party/pybind11/tools/clang'
Synchronizing submodule url for 'cmake/external/protobuf'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/benchmark'
Synchronizing submodule url for 'cmake/external/protobuf/third_party/googletest'
Synchronizing submodule url for 'cmake/external/re2'
Synchronizing submodule url for 'cmake/external/tensorboard'
Synchronizing submodule url for 'cmake/external/tvm'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/HalideIR'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dlpack'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/dmlc-core'
Synchronizing submodule url for 'cmake/external/tvm/3rdparty/rang'
Synchronizing submodule url for 'cmake/external/wil'
Synchronizing submodule url for 'server/external/spdlog'
2020-11-03 15:34:48,718 Build [DEBUG] - Subprocess completed. Return code=0
2020-11-03 15:34:48,718 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime'
['git', 'submodule', 'update', '--init', '--recursive']
2020-11-03 15:34:50,157 Build [DEBUG] - Subprocess completed. Return code=0
2020-11-03 15:34:50,158 Build [INFO] - Generating CMake build tree
2020-11-03 15:34:50,159 Build [DEBUG] - Running subprocess in '/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo'
['/usr/local/bin/cmake', '/home/xonobo/github/onnxruntime/cmake', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_BUILD_WINML_TESTS=ON', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-Donnxruntime_DEV_MODE=ON', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-Donnxruntime_USE_CUDA=OFF', '-Donnxruntime_CUDNN_HOME=', '-Donnxruntime_USE_FEATURIZERS=OFF', '-Donnxruntime_CUDA_HOME=', '-Donnxruntime_USE_JEMALLOC=OFF', '-Donnxruntime_USE_MIMALLOC_STL_ALLOCATOR=OFF', '-Donnxruntime_USE_MIMALLOC_ARENA_ALLOCATOR=OFF', '-Donnxruntime_ENABLE_PYTHON=OFF', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_SHARED_LIB=OFF', '-Donnxruntime_USE_EIGEN_FOR_BLAS=ON', '-Donnxruntime_USE_OPENBLAS=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_USE_MKLML=OFF', '-Donnxruntime_USE_NGRAPH=OFF', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_OPENMP=OFF', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_NUPHAR=OFF', '-Donnxruntime_USE_TENSORRT=OFF', '-Donnxruntime_TENSORRT_HOME=', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_MIGRAPHX_HOME=', '-Donnxruntime_CROSS_COMPILING=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_DISABLE_ORT_FORMAT_LOAD=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_MSVC_STATIC_RUNTIME=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ARMNN=OFF', '-Donnxruntime_ARMNN_RELU_USE_CPU=ON', '-Donnxruntime_ARMNN_BN_USE_CPU=ON', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_USE_HOROVOD=OFF', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_OPENVINO=ON', '-Donnxruntime_USE_OPENVINO_MYRIAD=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP16=ON', '-Donnxruntime_USE_OPENVINO_CPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_VAD_M=OFF', '-Donnxruntime_USE_OPENVINO_VAD_F=OFF', '-Donnxruntime_USE_OPENVINO_BINARY=ON', '-Donnxruntime_USE_FULL_PROTOBUF=ON', '-DProtobuf_USE_STATIC_LIBS=ON', '-Donnxruntime_PYBIND_EXPORT_OPSCHEMA=OFF', '-Donnxruntime_ENABLE_MEMLEAK_CHECKER=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo']
Use gtest from submodule
Use protobuf from submodule
-- 
-- 3.11.3.0
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-ml.proto
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-operators-ml.proto
Generated: /home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/external/onnx/onnx/onnx-data.proto
-- 
-- ******** Summary ********
--   CMake version         : 3.18.2
--   CMake command         : /usr/local/bin/cmake
--   System                : Linux
--   C++ compiler          : /usr/bin/c++
--   C++ compiler version  : 7.5.0
--   CXX flags             :  -Wnon-virtual-dtor
--   Build type            : RelWithDebInfo
--   Compile definitions   : ENABLE_ORT_FORMAT_LOAD;EIGEN_MPL2_ONLY;USE_EIGEN_FOR_BLAS
--   CMAKE_PREFIX_PATH     : 
--   CMAKE_INSTALL_PREFIX  : /usr/local
--   CMAKE_MODULE_PATH     : /home/xonobo/github/onnxruntime/cmake/external
-- 
--   ONNX version          : 1.7.0
--   ONNX NAMESPACE        : onnx
--   ONNX_BUILD_TESTS      : OFF
--   ONNX_BUILD_BENCHMARKS : OFF
--   ONNX_USE_LITE_PROTO   : OFF
--   ONNXIFI_DUMMY_BACKEND : OFF
--   ONNXIFI_ENABLE_EXT    : OFF
-- 
--   Protobuf compiler     : 
--   Protobuf includes     : 
--   Protobuf libraries    : 
--   BUILD_ONNX_PYTHON     : OFF
CMake Error at CMakeLists.txt:940 (message):
  Unsupported OpenVINO version:

-- Configuring incomplete, errors occurred!
See also "/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/CMakeFiles/CMakeOutput.log".
See also "/home/xonobo/github/onnxruntime/build/Linux/RelWithDebInfo/CMakeFiles/CMakeError.log".
Traceback (most recent call last):
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 1794, in <module>
    sys.exit(main())
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 1723, in main
    args, cmake_extra_args)
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 895, in generate_build_tree
    cwd=config_build_dir)
  File "/home/xonobo/github/onnxruntime/tools/ci_build/build.py", line 434, in run_subprocess
    env=my_env, shell=shell)
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/usr/local/bin/cmake', '/home/xonobo/github/onnxruntime/cmake', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_BUILD_WINML_TESTS=ON', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-Donnxruntime_DEV_MODE=ON', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-Donnxruntime_USE_CUDA=OFF', '-Donnxruntime_CUDNN_HOME=', '-Donnxruntime_USE_FEATURIZERS=OFF', '-Donnxruntime_CUDA_HOME=', '-Donnxruntime_USE_JEMALLOC=OFF', '-Donnxruntime_USE_MIMALLOC_STL_ALLOCATOR=OFF', '-Donnxruntime_USE_MIMALLOC_ARENA_ALLOCATOR=OFF', '-Donnxruntime_ENABLE_PYTHON=OFF', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_SHARED_LIB=OFF', '-Donnxruntime_USE_EIGEN_FOR_BLAS=ON', '-Donnxruntime_USE_OPENBLAS=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_USE_MKLML=OFF', '-Donnxruntime_USE_NGRAPH=OFF', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_OPENMP=OFF', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_NUPHAR=OFF', '-Donnxruntime_USE_TENSORRT=OFF', '-Donnxruntime_TENSORRT_HOME=', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_MIGRAPHX_HOME=', '-Donnxruntime_CROSS_COMPILING=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_DISABLE_ORT_FORMAT_LOAD=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_MSVC_STATIC_RUNTIME=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ARMNN=OFF', '-Donnxruntime_ARMNN_RELU_USE_CPU=ON', '-Donnxruntime_ARMNN_BN_USE_CPU=ON', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_USE_HOROVOD=OFF', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_OPENVINO=ON', '-Donnxruntime_USE_OPENVINO_MYRIAD=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_GPU_FP16=ON', '-Donnxruntime_USE_OPENVINO_CPU_FP32=OFF', '-Donnxruntime_USE_OPENVINO_VAD_M=OFF', '-Donnxruntime_USE_OPENVINO_VAD_F=OFF', '-Donnxruntime_USE_OPENVINO_BINARY=ON', '-Donnxruntime_USE_FULL_PROTOBUF=ON', '-DProtobuf_USE_STATIC_LIBS=ON', '-Donnxruntime_PYBIND_EXPORT_OPSCHEMA=OFF', '-Donnxruntime_ENABLE_MEMLEAK_CHECKER=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo']' returned non-zero exit status 1.

I think this is probably the same issue. as a workaround, can you try to run the setupvars.sh script using the full path (without symlink) i.e. source /opt/intel/openvino_2021.1.110/bin/setupvars.sh instead of /opt/intel/openvino/bin/setupvars.sh ?

it's checking the version from INTEL_OPENVINO_DIR env variable, so we need to ensure the version string (openvino_2021.1.110) is in the that path.

smkarlap commented 3 years ago

Yes, the issue seems to be with using the symbolic link. Please use the full path as a workaround for now. We are pushing a fix to this limitation which should be merged in about a week.

xonobo commented 3 years ago

replaced the symbolic link with the exact path but still get the same error.

echo $INTEL_OPENVINO_DIR 
/opt/intel/openvino_2021.1.110

CMake Error at CMakeLists.txt:940 (message):
  Unsupported OpenVINO version:

-- Configuring incomplete, errors occurred!
jywu-msft commented 3 years ago

replaced the symbolic link with the exact path but still get the same error.

echo $INTEL_OPENVINO_DIR 
/opt/intel/openvino_2021.1.110
CMake Error at CMakeLists.txt:940 (message):
  Unsupported OpenVINO version:

-- Configuring incomplete, errors occurred!

which commit of onnxruntime is this? is it latest master branch?

MaajidKhan commented 3 years ago

replaced the symbolic link with the exact path but still get the same error.

echo $INTEL_OPENVINO_DIR 
/opt/intel/openvino_2021.1.110
CMake Error at CMakeLists.txt:940 (message):
  Unsupported OpenVINO version:

-- Configuring incomplete, errors occurred!

@xonobo I don't see the issue on our end. I was just able to successfully build it with the latest master. image

xonobo commented 3 years ago

It is the latest release v1.5.3 Let me check the master.

xonobo commented 3 years ago

Can build the master for vino but tests at the end failed and could not obtain a wheel file.

My build command: ./build.sh --config RelWithDebInfo --build_shared_lib --build_wheel --build_dir build_vino --use_openvino GPU_FP16 --cmake_extra_defines CMAKE_INSTALL_PREFIX=/opt/onnxruntime

Failed part:

1: [  PASSED  ] 2199 tests.
1: [  FAILED  ] 38 tests, listed below:
1: [  FAILED  ] ActivationOpTest.Selu
1: [  FAILED  ] MathOpTest.Clip_Default
1: [  FAILED  ] MathOpTest.Clip
1: [  FAILED  ] MathOpTest.Clip_Relu6
1: [  FAILED  ] MathOpTest.Clip_Relu1
1: [  FAILED  ] MathOpTest.Add_float
1: [  FAILED  ] MathOpTest.Sub
1: [  FAILED  ] MathOpTest.Sub_Broadcast_Scalar
1: [  FAILED  ] MathOpTest.Mul
1: [  FAILED  ] MathOpTest.Min_6
1: [  FAILED  ] MathOpTest.Min_8
1: [  FAILED  ] MathOpTest.Max_6
1: [  FAILED  ] MathOpTest.Mean_6
1: [  FAILED  ] MathOpTest.Mean_8
1: [  FAILED  ] SoftmaxOperator.Simple
1: [  FAILED  ] SoftmaxOperator.LargeNumber
1: [  FAILED  ] SoftmaxOperator.ThreeDimsAxis1
1: [  FAILED  ] SoftmaxOperator.ThreeDimsAxis2
1: [  FAILED  ] SoftmaxOperator.ThreeDimsNegativeAxis
1: [  FAILED  ] InstanceNormalizationOpTest.InstanceNorm
1: [  FAILED  ] InstanceNormalizationOpTest.InstanceNormBatch1
1: [  FAILED  ] InstanceNormalizationOpTest.InstanceNorm_2
1: [  FAILED  ] LRNTest.LRN_1
1: [  FAILED  ] LRNTest.LRN_2
1: [  FAILED  ] PoolTest.GlobalAveragePool
1: [  FAILED  ] PoolTest.GlobalLpPool
1: [  FAILED  ] ReductionOpTest.ReductionVariationTest
1: [  FAILED  ] ReductionOpTest.ReduceSum_apex_matrix_large
1: [  FAILED  ] ReductionOpTest.ReduceSum_apex_bert
1: [  FAILED  ] ReductionOpTest.ReduceSum_batch_by_two
1: [  FAILED  ] ReductionOpTest.ReduceSum_batch_by_seq_by_128
1: [  FAILED  ] ReductionOpTest.ReduceSum_bert_selected_batch_size
1: [  FAILED  ] ReductionOpTest.ReduceSum_apex_more
1: [  FAILED  ] GatherOpTest.Gather_axis1_indices2d_int32
1: [  FAILED  ] TensorOpTest.SpaceToDepthTest_1
1: [  FAILED  ] TensorOpTest.DepthToSpaceTest_1
1: [  FAILED  ] TransposeOpTest.ThreeDim
1: [  FAILED  ] TransposeOpTest.ThreeDimSuffix

Is this expected and hope to be corrected in the next release?

I guess FP16 precision fails to satisfy expected accuracy. A fail example:

1: [ RUN      ] MathOpTest.Mul
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:156: Failure
1: The difference between expected[i] and output[i] is 0.0031251907348632812, which exceeds threshold, where
1: expected[i] evaluates to 8.8000001907348633,
1: output[i] evaluates to 8.796875, and
1: threshold evaluates to 9.9999997473787516e-05.
1: i:1, provider_type: OpenVINOExecutionProvider
1: [  FAILED  ] MathOpTest.Mul (690 ms)

Is it possible to increase the threshold for fp16 precison?

xonobo commented 3 years ago

I also tried GPU_FP32 with this command ./build.sh --config RelWithDebInfo --build_shared_lib --build_wheel --build_dir build_vino --use_openvino GPU_FP32 --cmake_extra_defines CMAKE_INSTALL_PREFIX=/opt/onnxruntime

But tests failed again and this time I found fails different than precision problems I guess:

1: [ RUN      ] GatherOpTest.Gather_axis1_indices2d_int32
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 0
1:   output[i]
1:     Which is: 1
1: i:1, provider_type: OpenVINOExecutionProvider
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 1
1:   output[i]
1:     Which is: 2
1: i:3, provider_type: OpenVINOExecutionProvider
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 10
1:   output[i]
1:     Which is: 11
1: i:5, provider_type: OpenVINOExecutionProvider
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 11
1:   output[i]
1:     Which is: 12
1: i:7, provider_type: OpenVINOExecutionProvider
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 20
1:   output[i]
1:     Which is: 21
1: i:9, provider_type: OpenVINOExecutionProvider
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:66: Failure
1: Expected equality of these values:
1:   expected[i]
1:     Which is: 21
1:   output[i]
1:     Which is: 22
1: i:11, provider_type: OpenVINOExecutionProvider

Another fail:

1: [ RUN      ] MathOpTest.Clip_6
1: 2020-11-05 15:35:03.789391137 [W:onnxruntime:Clip, model.cc:138 Model] ONNX Runtime only *guarantees* support for models stamped with opset version 7 or above for opset domain 'ai.onnx'. Please upgrade your model to opset 7 or higher. For now, this opset 6 model may run depending upon legacy support of some older opset version operators.
1: 2020-11-05 15:35:03.789506544 [W:onnxruntime:Clip, model.cc:138 Model] ONNX Runtime only *guarantees* support for models stamped with opset version 7 or above for opset domain 'ai.onnx'. Please upgrade your model to opset 7 or higher. For now, this opset 6 model may run depending upon legacy support of some older opset version operators.
1: [       OK ] MathOpTest.Clip_6 (387 ms)
1: [ RUN      ] MathOpTest.Clip_Default
1: 2020-11-05 15:35:04.180333535 [E:onnxruntime:Clip, inference_session.cc:1209 operator()] Exception during initialization: /home/bozkalayci/github/onnxruntime/onnxruntime/core/providers/openvino/backends/basic_backend.cc:77 onnxruntime::openvino_ep::BasicBackend::BasicBackend(const onnx::ModelProto&, onnxruntime::openvino_ep::GlobalContext&, const onnxruntime::openvino_ep::SubGraphContext&) [OpenVINO-EP]  Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_44_0: Unsupported number of dimensions: 0
1: 
1: 2020-11-05 15:35:04.180349260 [E:onnxruntime:Default, provider_test_utils.cc:546 ExecuteModel] Initialize failed with status: Exception during initialization: /home/bozkalayci/github/onnxruntime/onnxruntime/core/providers/openvino/backends/basic_backend.cc:77 onnxruntime::openvino_ep::BasicBackend::BasicBackend(const onnx::ModelProto&, onnxruntime::openvino_ep::GlobalContext&, const onnxruntime::openvino_ep::SubGraphContext&) [OpenVINO-EP]  Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_44_0: Unsupported number of dimensions: 0
1: 
1: /home/bozkalayci/github/onnxruntime/onnxruntime/test/providers/provider_test_utils.cc:548: Failure
1: Value of: status.IsOK()
1:   Actual: false
1: Expected: true
1: Exception during initialization: /home/bozkalayci/github/onnxruntime/onnxruntime/core/providers/openvino/backends/basic_backend.cc:77 onnxruntime::openvino_ep::BasicBackend::BasicBackend(const onnx::ModelProto&, onnxruntime::openvino_ep::GlobalContext&, const onnxruntime::openvino_ep::SubGraphContext&) [OpenVINO-EP]  Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_44_0: Unsupported number of dimensions: 0
1: 
1: [  FAILED  ] MathOpTest.Clip_Default (4 ms)

List of all fails:

1: [  PASSED  ] 2231 tests.
1: [  FAILED  ] 6 tests, listed below:
1: [  FAILED  ] MathOpTest.Clip_Default
1: [  FAILED  ] MathOpTest.Clip
1: [  FAILED  ] MathOpTest.Clip_Relu6
1: [  FAILED  ] MathOpTest.Clip_Relu1
1: [  FAILED  ] MathOpTest.Sub_Broadcast_Scalar
1: [  FAILED  ] GatherOpTest.Gather_axis1_indices2d_int32
1: 
1:  6 FAILED TESTS
MaajidKhan commented 3 years ago

@xonobo The GPU_FP16 failures are due to accuracy mismatch as slight accuracy change is expected with fp32 to fp16 conversion + changing the threshold is something we will follow up internally on.

coming to GPU_FP32 (6 Failed Tests): [ FAILED ] MathOpTest.Clip_Default --> It works with OpenVINO Latest Master (Built from source) [ FAILED ] MathOpTest.Clip --> It works with OpenVINO Latest Master [ FAILED ] MathOpTest.Clip_Relu6 --> It works with OpenVINO Latest Master [ FAILED ] MathOpTest.Clip_Relu1 --> It works with OpenVINO Latest Master [ FAILED ] MathOpTest.Sub_Broadcast_Scalar --> It works with OpenVINO Latest Master [ FAILED ] GatherOpTest.Gather_axis1_indices2d_int32 --> This one has an output mismatch for some indexes, we will be fixing this internally

you can find all this fixed with the next release

MaajidKhan commented 3 years ago

@danielecazzari The issue of Unsupported OpenVINO version when shortcut is used is now fixed and merged. you can now use onnxruntime latest master and you wouldn't see the issue any more.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale due to inactivity and will be closed in 7 days if no further activity occurs. If further support is needed, please provide an update and/or more details.