Test does not fail during the compilation stage if build fails when `build_locally=False`

reframe-hpc / reframe

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

https://reframe-hpc.readthedocs.org

BSD 3-Clause "New" or "Revised" License

214 stars 101 forks source link

Test does not fail during the compilation stage if build fails when `build_locally=False` #3111

Open vkarak opened 7 months ago

vkarak commented 7 months ago

This is confusing because (a) this behaviour is different when build_locally=True and (b) the test is successful if it's compile-only (see build fixtures).

@giordano I think you've hit this before but I'm not sure if you've opened an issue already.

giordano commented 7 months ago

I had opened #2936 (fixed by #2993), which was about build job via PBS failing, but ReFrame didn't know about it. But this ticket sounds slightly different (and not specific to PBS)?

vkarak commented 6 months ago

It seems to be related to the squeue backend that I have been testing and it seems not to be a bug after all, but a limitation of this backend, since we cannot retrieve the exit code. I will investigate further and add at least a note in the docs.