[OV] Updated performance properties

itlab-vision / dl-benchmark

Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.

http://hpc-education.unn.ru/dli

Apache License 2.0

27 stars 37 forks source link

[OV] Updated performance properties #550

Closed a-sidorova closed 1 month ago

a-sidorova commented 2 months ago

Details:

Properties CPU_THREADS_NUM and CPU_THROUGHPUT_STREAMS are deprecated. Now we have to use props.inference_num_threads and props.num_streams. The link to the documentation.
Added smoke tests to validate the case when the user manually sets thread count and stream count