search

pact-foundation / pact-jvm

JVM version of Pact. Enables consumer driven contract testing, providing a mock service and DSL for the consumer project, and interaction playback and verification for the service provider project.
https://docs.pact.io
Apache License 2.0
1.08k stars 479 forks source link

Inconsistent failures when running test suite in parallel #1274

Open Rafaesp opened 3 years ago

Rafaesp commented 3 years ago

Regardless of https://github.com/pact-foundation/pact-jvm/issues/1223, I'm afraid I still can see inconsistent verifications being published when running tests in parallel. I'm running pact 4.1.12.

I can see this log message when running in parallel: Published verification result of 'Ok(interactionIds=[483d8aa80ffd81d350c2747585c9f9a9061e2458, c950f9b78486e2b946d2aaa2386aa132b791dce9, c1895b2c00ef5e3546f3456648cb4e8d411e0379, 27e16d373d2a1d79e6ce32772df976143688efba, 16d7609ee4facb81e8bfc64ba8831e70bcd859dc])' for consumer but Published verification result of 'Ok(interactionIds=[16d7609ee4facb81e8bfc64ba8831e70bcd859dc, 483d8aa80ffd81d350c2747585c9f9a9061e2458, 27e16d373d2a1d79e6ce32772df976143688efba, f410a554ca95ccc30e1b974c562e9a5d61a95c8f, c950f9b78486e2b946d2aaa2386aa132b791dce9, c1895b2c00ef5e3546f3456648cb4e8d411e0379])' for consumer when running sequentially

uglyog commented 3 years ago

Are you able to provide an example project that demonstrates this issue. Diagnosing parallel tests issues is hard to do if I can't replicate the problem.