Updating OpenVINO to use new capabilities of 2023.0 release.
Applied changes:
Remove InferRequest use in favor of direct CompiledModel calls. New class behavior create InferRequest on demand when inference is run for the first time and holds it internally. More info here.
Use of new shared_memory mode to limit copies of input data. If project is implemented in a manner to run sequentially, it can be left as True. If not, the new mode can be exposed as additional flag to the wrapper method. More on the feature here.
(note to maintainers: requires benchmarking on project's side)
Updating OpenVINO to use new capabilities of 2023.0 release.
Applied changes:
InferRequestuse in favor of directCompiledModelcalls. New class behavior createInferRequeston demand when inference is run for the first time and holds it internally. More info here.shared_memorymode to limit copies of input data. If project is implemented in a manner to run sequentially, it can be left asTrue. If not, the new mode can be exposed as additional flag to the wrapper method. More on the feature here. (note to maintainers: requires benchmarking on project's side)OVDicthere.Thanks in advance for the review!