intel / onnxruntime

ONNX Runtime: cross-platform, high performance scoring engine for ML models
MIT License
56 stars 22 forks source link

Updated fix for setting precision with Auto Plugin #403

Closed sfatimar closed 1 month ago

sfatimar commented 1 month ago

Description

Precision Accuracy is being set for AUTO as well Cache dir is being set for ov::Model Type (Compile Model Function) Fast Compile with Model Path is only being used for GPU currently.

Motivation and Context

The bug fix contains fix for CVS-142074 | [Adobe][AUTO] Corruption with Adobe InPainting when run with Accuracy precision | Caused by CVS-146476 CVS-146476 | ONNX option precision=ACCRUACY doesn't pass to OV Runtime | Fixing in ONNX OV EP CVS-146816 | [ONNX] option cache_dir doesn't pass to OV Runtime | Impact the model cache. Fixing in ONNX EP. .

sfatimar commented 1 month ago

LGTM