intel / onnxruntime

ONNX Runtime: cross-platform, high performance scoring engine for ML models
MIT License
56 stars 22 forks source link

Add provider option for CPU fallback #385

Closed preetha-intel closed 2 months ago

preetha-intel commented 2 months ago

Description

Add provider option to handle the fallback from OV NPU to OV CPU for compilation failures.

Motivation and Context

This option provides the flexibility for user to opt for fallback incase of compilation failures on NPU. By default there is no fallback to OV CPU.

The PR also handles the build error for Windows Debug build.

preetha-intel commented 2 months ago

POC is redesigned to add support for Build time option and Session Option. Closing the PR as its no longer relevant.