halide / Halide

a language for fast, portable data-parallel computation
https://halide-lang.org
Other
5.9k stars 1.07k forks source link

Vulkan failures #7642

Open steven-johnson opened 1 year ago

steven-johnson commented 1 year ago

Some recent tests are failing with e.g.

HL_TARGET=host-vulkan-vk_int8-vk_int16-vk_int64-vk_float16-vk_float64-vk_v13
HL_JIT_TARGET=host-vulkan-vk_int8-vk_int16-vk_int64-vk_float16-vk_float64-vk_v13
#CTEST_RESOURCE_GROUP_COUNT=
/home/halidenightly/build_bot/worker/halide-testbranch-main-llvm16-x86-64-linux-cmake/halide-build/test/correctness/correctness_gpu_data_flows
Error: VulkanBlockAllocator: Unable to allocate region! Invalid device memory handle!
Vulkan: Failed to allocate device memory!
Required regular expression not found. Regex=[Success!]

See https://buildbot.halide-lang.org/master/#/builders/58/builds/10/steps/36/logs/correctness_gpu_data_flows

derek-gerstmann commented 1 year ago

Strange … these seemed to pass on the release/16.x branch

derek-gerstmann commented 1 year ago

Looks like a sporadic failure on linux-worker-4 … we’ve had plenty of successful builds, so I’m not sure what’s triggering this. I’ll investigate further.