I would have thought the new version is equivalent to the old here but apparently these are different. It seems to be possible with the old version for the test function to be invoked before the application has truly reached the "RUNNING" state. If this results in an application under test failing to read test data submitted during the test (because it was thought to have arrived before the test actually began).
However from reading the logs of test failures, the following sequence of log events is a pretty good predictor of failure for certain tests.
process foo changed state from CREATED -> REBALANCING
commencing test function
I don't really understand how I could see that sequence of log entries without (.isRunning new-state) returning true when it was just reported as a "REBALANCING" state.
With this change in place, re-running tests that would produce the failure sequence above, instead I see
process foo changed state from CREATED -> REBALANCING
process foo changed state from REBALANCING -> RUNNING
commencing test function
I would have thought the new version is equivalent to the old here but apparently these are different. It seems to be possible with the old version for the test function to be invoked before the application has truly reached the "RUNNING" state. If this results in an application under test failing to read test data submitted during the test (because it was thought to have arrived before the test actually began).
However from reading the logs of test failures, the following sequence of log events is a pretty good predictor of failure for certain tests.
process foo changed state from CREATED -> REBALANCING commencing test function
I don't really understand how I could see that sequence of log entries without
(.isRunning new-state)
returningtrue
when it was just reported as a "REBALANCING" state.With this change in place, re-running tests that would produce the failure sequence above, instead I see
process foo changed state from CREATED -> REBALANCING process foo changed state from REBALANCING -> RUNNING commencing test function
Checklist