Option to disable cpu fallback in OV

intel / onnxruntime

ONNX Runtime: cross-platform, high performance scoring engine for ML models

MIT License

56 stars 22 forks source link

Closed preetha-intel closed 2 months ago

preetha-intel commented 2 months ago

Provide a build time and session option to disable CPU fallback.

The option to control fallback from OV NPU to OV CPU is added for user's ease of control with hardware targets.
The build time option "NPU_NO_CPU_FALLBACK" disables OV CPU fallback.
The session Option "kOrtSessionOptionsDisableCPUEPFallback" disables OV CPU and MLAS CPU fallback.

preetha-intel commented 2 months ago