openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
7.29k stars 2.27k forks source link

[Bug]: running failed with error ProgramBuilder build failed on GPU #26476

Open DragonFlyEast opened 2 months ago

DragonFlyEast commented 2 months ago

OpenVINO Version

2024.0.0

Operating System

Windows System

Device used for inference

GPU

Framework

None

Model used

No response

Issue description

Windows Intel(R) Xeon(R) CPU E3-1285L v4 ( Intel(R) Iris(TM) Pro Graphics P6300)

hello_query_device

[ INFO ] Build ................................. 2024.0.0-14509-34caeefd078
[ INFO ] 
[ INFO ] Available devices: 
[ INFO ] CPU
[ INFO ]    SUPPORTED_PROPERTIES: 
[ INFO ]        Immutable: AVAILABLE_DEVICES : ""
[ INFO ]        Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ]        Immutable: RANGE_FOR_STREAMS : 1 8
[ INFO ]        Immutable: EXECUTION_DEVICES : CPU
[ INFO ]        Immutable: FULL_DEVICE_NAME : Intel(R) Xeon(R) CPU E3-1285L v4 @ 3.40GHz
[ INFO ]        Immutable: OPTIMIZATION_CAPABILITIES : FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ]        Immutable: DEVICE_TYPE : integrated
[ INFO ]        Immutable: DEVICE_ARCHITECTURE : intel64
[ INFO ]        Mutable: NUM_STREAMS : 1
[ INFO ]        Mutable: AFFINITY : NONE
[ INFO ]        Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ]        Mutable: PERF_COUNT : NO
[ INFO ]        Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ]        Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ]        Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ]        Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]        Mutable: ENABLE_CPU_PINNING : YES
[ INFO ]        Mutable: SCHEDULING_CORE_TYPE : ANY_CORE
[ INFO ]        Mutable: ENABLE_HYPER_THREADING : YES
[ INFO ]        Mutable: DEVICE_ID : ""
[ INFO ]        Mutable: CPU_DENORMALS_OPTIMIZATION : NO
[ INFO ]        Mutable: LOG_LEVEL : LOG_NONE
[ INFO ]        Mutable: CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE : 1
[ INFO ]        Mutable: DYNAMIC_QUANTIZATION_GROUP_SIZE : 0
[ INFO ]        Mutable: KV_CACHE_PRECISION : f16
[ INFO ] 
[ INFO ] GPU.0
[ INFO ]    SUPPORTED_PROPERTIES: 
[ INFO ]        Immutable: AVAILABLE_DEVICES : 0 
[ INFO ]        Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 2 1
[ INFO ]        Immutable: RANGE_FOR_STREAMS : 1 2
[ INFO ]        Immutable: OPTIMAL_BATCH_SIZE : 1
[ INFO ]        Immutable: MAX_BATCH_SIZE : 1
[ INFO ]        Immutable: DEVICE_ARCHITECTURE : GPU: vendor=0x8086 arch=Intel(R) Iris(TM) Pro Graphics P6300
[ INFO ]        Immutable: FULL_DEVICE_NAME : Intel(R) Iris(TM) Pro Graphics P6300 (iGPU)
[ INFO ]        Immutable: DEVICE_UUID : 00000000000000000000000000000000
[ INFO ]        Immutable: DEVICE_LUID : 0000000000000000
[ INFO ]        Immutable: DEVICE_TYPE : integrated
[ INFO ]        Immutable: DEVICE_GOPS : {f16:1766.4,f32:883.2,i8:883.2,u8:883.2}
[ INFO ]        Immutable: OPTIMIZATION_CAPABILITIES : FP32 BIN EXPORT_IMPORT
[ INFO ]        Immutable: GPU_DEVICE_TOTAL_MEM_SIZE : 13679969895
[ INFO ]        Immutable: GPU_UARCH_VERSION : unknown
[ INFO ]        Immutable: GPU_EXECUTION_UNITS_COUNT : 48
[ INFO ]        Immutable: GPU_MEMORY_STATISTICS : ""
[ INFO ]        Mutable: PERF_COUNT : NO
[ INFO ]        Mutable: MODEL_PRIORITY : MEDIUM
[ INFO ]        Mutable: GPU_HOST_TASK_PRIORITY : MEDIUM
[ INFO ]        Mutable: GPU_QUEUE_PRIORITY : MEDIUM
[ INFO ]        Mutable: GPU_QUEUE_THROTTLE : MEDIUM
[ INFO ]        Mutable: GPU_ENABLE_LOOP_UNROLLING : YES
[ INFO ]        Mutable: GPU_DISABLE_WINOGRAD_CONVOLUTION : NO
[ INFO ]        Mutable: CACHE_DIR : ""
[ INFO ]        Mutable: CACHE_MODE : optimize_speed
[ INFO ]        Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ]        Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ]        Mutable: COMPILATION_NUM_THREADS : 8
[ INFO ]        Mutable: NUM_STREAMS : 1
[ INFO ]        Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]        Mutable: INFERENCE_PRECISION_HINT : f16
[ INFO ]        Mutable: ENABLE_CPU_PINNING : NO
[ INFO ]        Mutable: DEVICE_ID : 0
[ INFO ] 

benchmark_app -m face-detection-0204.xml -d GPU.0 -niter 3200

[Step 1/11] Parsing and validating input arguments
[ INFO ] Parsing input parameters
[Step 2/11] Loading OpenVINO Runtime
[ INFO ] OpenVINO:
[ INFO ] Build ................................. 2024.0.0-14509-34caeefd078
[ INFO ] 
[ INFO ] Device info:
[ INFO ] GPU
[ INFO ] Build ................................. 2024.0.0-14509-34caeefd078
[ INFO ] 
[ INFO ] 
[Step 3/11] Setting device configuration
[ WARNING ] Performance hint was not explicitly specified in command line. Device(GPU.0) performance hint will be set to THROUGHPUT.
[Step 4/11] Reading model files
[ INFO ] Loading model files
[ INFO ] Read model took 35.23 ms
[ INFO ] Original model I/O parameters:
[ INFO ] Network inputs:
[ INFO ]     image (node: image) : f32 / [N,C,H,W] / [1,3,448,448]
[ INFO ] Network outputs:
[ INFO ]     detection_out (node: detection_out) : f32 / [...] / [1,1,200,7]
[Step 5/11] Resizing model to match image sizes and given batch
[Step 6/11] Configuring input of the model
[ INFO ] Model batch size: 1
[ INFO ] Network inputs:
[ INFO ]     image (node: image) : u8 / [N,C,H,W] / [1,3,448,448]
[ INFO ] Network outputs:
[ INFO ]     detection_out (node: detection_out) : f32 / [...] / [1,1,200,7]
[Step 7/11] Loading the model to the device
[ ERROR ] Exception from src\inference\src\cpp\core.cpp:109:
Exception from src\inference\src\dev\plugin.cpp:54:
Check 'false' failed at src\plugins\intel_gpu\src\plugin\program_builder.cpp:179:
[GPU] ProgramBuilder build failed!
clGetKernelInfo

Step-by-step reproduction

No response

Relevant log output

No response

Issue submission checklist

DragonFlyEast commented 1 month ago

@mlukasze @Wovchena @avitial

Is there a workaround for this problem?

Is there anyone else experiencing this problem?

avitial commented 1 month ago

@DragonFlyEast have you tried inferencing with other models and is the error always the same? If possible share the graphics driver version used, have you tried upgrading to the latest graphics driver version available for your system? Note the processor you are using is Broadwell which is a 5th Gen CPU. According to the System Requirements it does not meet the specifications listed there. So the issue you observe might be expected as it does not meet the minimum hardware requirements.

DragonFlyEast commented 1 month ago

@avitial

According to the System Requirements, the list of supported GPU has Intel® Iris® Pro Graphics. Intel(R) Xeon(R) CPU E3-1285L v4 does have Intel(R) Iris(TM) Pro Graphics. Is it necessary to meet both of CPU and GPU requirements? thanks!