ProcessMaker / ellucian-shared-tests

1 stars 0 forks source link

Ensure Accuracy of Parallel Execution #4

Open eamonnpm opened 4 years ago

eamonnpm commented 4 years ago

We are firing off the test executors in parallel and then collecting their responses into a summary screen. Currently the behavior seen with the process design is not stable, and results in more executions than would be expected. Both the test_index++ & test execution scripts are happening more than the expected 7 times (for the given 7 tests), and the test output is inconsistently added to the resulting request's data object. Both of these things need to be investigated for flaws in the BPM design or bugs in the BPM engine.

One other thing we need to ensure is that the test_index passed to the test executor is consistent.

eamonnpm commented 4 years ago

Given the fix by @caleeli in https://github.com/ProcessMaker/processmaker/pull/3094, and the following process, we are able to execute the specified tests in parallel, without any data loss or duplication throughout the process.

Screen Shot 2020-05-05 at 5 46 24 PM

Show Results: Screen Shot 2020-05-05 at 6 00 56 PM