mweinelt
commented
1 year ago Works with the discrete Intel GPU I have access to:
03:00.0 VGA compatible controller: Intel Corporation DG2 [Arc A380] (rev 05)
$ python tools/benchmark_tool/benchmark_app.py -m src/bindings/python/tests/test_utils/u
tils/test_model_fp32.xml -d GPU
[Step 1/11] Parsing and validating input arguments
[ INFO ] Parsing input parameters
[Step 2/11] Loading OpenVINO Runtime
[ INFO ] OpenVINO:
[ INFO ] Build ................................. 2023.0.0-000--
[ INFO ]
[ INFO ] Device info:
[ INFO ] GPU
[ INFO ] Build ................................. 2023.0.0-000--
[ INFO ]
[ INFO ]
[Step 3/11] Setting device configuration
[ WARNING ] Performance hint was not explicitly specified in command line. Device(GPU) performance hint will be set to PerformanceMode.THROUGHPUT.
[Step 4/11] Reading model files
[ INFO ] Loading model files
[ INFO ] Read model took 2.42 ms
[ INFO ] Original model I/O parameters:
[ INFO ] Model inputs:
[ INFO ] data (node: data) : f32 / [...] / [1,3,32,32]
[ INFO ] Model outputs:
[ INFO ] fc_out (node: fc_out) : f32 / [...] / [1,10]
[Step 5/11] Resizing model to match image sizes and given batch
[ INFO ] Model batch size: 1
[Step 6/11] Configuring input of the model
[ INFO ] Model inputs:
[ INFO ] data (node: data) : u8 / [N,C,H,W] / [1,3,32,32]
[ INFO ] Model outputs:
[ INFO ] fc_out (node: fc_out) : f32 / [...] / [1,10]
[Step 7/11] Loading the model to the device
[ INFO ] Compile model took 1355.77 ms
[Step 8/11] Querying optimal runtime parameters
[ INFO ] Model:
[ INFO ] OPTIMAL_NUMBER_OF_INFER_REQUESTS: 1024
[ INFO ] NETWORK_NAME: test_model
[ INFO ] EXECUTION_DEVICES: ['GPU.0']
[ INFO ] AUTO_BATCH_TIMEOUT: 1000
[ INFO ] LOADED_FROM_CACHE: False
[Step 9/11] Creating infer requests and preparing input tensors
[ WARNING ] No input files were given for input 'data'!. This input will be filled with random values!
[ INFO ] Fill input 'data' with random values
[Step 10/11] Measuring performance (Start inference asynchronously, 1024 inference requests, limits: 60000 ms duration)
[ INFO ] Benchmarking in inference only mode (inputs filling are not included in measurement loop).
[ INFO ] First inference took 614.32 ms
[Step 11/11] Dumping statistics report
[ INFO ] Execution Devices:['GPU.0']
[ INFO ] Count: 7646208 iterations
[ INFO ] Duration: 60012.08 ms
[ INFO ] Latency:
[ INFO ] Median: 7.30 ms
[ INFO ] Average: 6.93 ms
[ INFO ] Min: 3.02 ms
[ INFO ] Max: 14.47 ms
[ INFO ] Throughput: 127411.15 FPS
andrey-skat
wb666greene
Describe the bug
Using a Celeron J4125 I am trying to run OpenVINO, but get
Steps To Reproduce
Steps to reproduce the behavior:
(It also fails using ssdlite_mobilenet_v2.xml from the frigate NVR package which is the one I really want to use, so I don't think this is a model-specific problem. I'm no expert though)
Expected behavior
Good question. I expected it not to fail with an error message, but I don't know what correct behaviour looks like. I'd like frigate to work, but it fails with the same error messages, so I hope that this is a smaller test case
Additional context
configuration.nix has
clinfo works:
If I set
LD_DEBUG=libsI can see quite voluminous output which includes severalfatallines. I don't know if these are relevant ...Notify maintainers
@tfmoraes
From git history: @mweinelt @superherointj
Metadata