search

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.94k stars 169 forks source link

[DeepSparse Evaluation API] UX Improvements #1568

Closed dbogunowicz closed 5 months ago

dbogunowicz commented 5 months ago

Enforce the planned UX for 1.7 release:

API:

res = evaluate(STUB | MODEL | MODEL_DEPLOYMENT| PIPELINE, datasets=Union[str, List[str]], integration=Optional[str])

CLI:

deepsparse.evaluate STUB | MODEL_ONNX | MODEL_DEPLOYMENT **args from above

For concrete usages see: #1580 or #1555