While working #24443, I realize that the unittest //sw/device/silicon_creator/lib/cert:cert_unittest had become unrunnable on host by mistake due to the following dependency:
This is now fixed by #24440 but it illustrates that it is very easy to make a unittest unrunnable on host by mistake. Unfortunately, since we run host tests using //..., those incompatible tests will simply be skipped in CI so they are disable without anyone realizing.
Out of curiosity, I looked at the list of test that are currently incompatible with host:
# incompatible.cquery
def format(target):
if "IncompatiblePlatformProvider" in providers(target):
return target.label
return ""
This means that those tests have been disabled by mistake, I think all of them due to the extra dependency on //sw/device/silicon_creator/lib:otbn_boot_services.
Short-term solution
Fix the dependency and make those tests runnable again.
Long-term solution
We need to ensure that we don't disable such tests silently in CI. This could either be a lint in the CI, or maybe a way to mark some tests in bazel as "must run on host".
Description
While working #24443, I realize that the unittest
//sw/device/silicon_creator/lib/cert:cert_unittest
had become unrunnable on host by mistake due to the following dependency:This is now fixed by #24440 but it illustrates that it is very easy to make a unittest unrunnable on host by mistake. Unfortunately, since we run host tests using
//...
, those incompatible tests will simply be skipped in CI so they are disable without anyone realizing.Out of curiosity, I looked at the list of test that are currently incompatible with host:
run with
This means that those tests have been disabled by mistake, I think all of them due to the extra dependency on
//sw/device/silicon_creator/lib:otbn_boot_services
.Short-term solution Fix the dependency and make those tests runnable again.
Long-term solution We need to ensure that we don't disable such tests silently in CI. This could either be a lint in the CI, or maybe a way to mark some tests in bazel as "must run on host".