Open bmcase opened 1 month ago
I've had it happen a couple times where a test will pass in the pre-commit stage but then the same test will fail when running in the CI.
I can recreate the test failing locally like in the CI if I run it with release and a feature flag. Here is an example:
cargo test --release --lib protocol::ipa_prf::tests::semi_honest_degenerate --features "shuttle multi-threading"
My question is if we should update the pre-commit tests to more exactly capture these scenarios that are run in the CI check.yml?
pre-commit
check.yml
In particular the CI (check.yml) seems to run the concurrency tests (which is where I've seen all these occur) but it seems the pre-commit does not.
- name: Run concurrency tests run: cargo test --release --features "shuttle multi-threading"
I've had it happen a couple times where a test will pass in the pre-commit stage but then the same test will fail when running in the CI.
I can recreate the test failing locally like in the CI if I run it with release and a feature flag. Here is an example:
cargo test --release --lib protocol::ipa_prf::tests::semi_honest_degenerate --features "shuttle multi-threading"
My question is if we should update the
pre-commit
tests to more exactly capture these scenarios that are run in the CIcheck.yml
?In particular the CI (
check.yml
) seems to run the concurrency tests (which is where I've seen all these occur) but it seems the pre-commit does not.