Report updation issue and test script syncing issues

[manjeetkiwiqa]

while running a test suite with multiple workers, Intermittently, test results for a few cases are not getting updated in the corresponding batch in Testomat. Running in debug mode, we can see in logs as "report couldn't be processed ' socket hang up'".

PFA snapshots for your reference. Count of total test scripts execution has anomaly with count of total Pass/Fail/skipped.

Another observed issue is syncing up test scripts and related details, in testomat. For this, we are relying on "sync:testomat": "TESTOMATIO= npx check-tests@latest CodeceptJS \"*/{.,_}{test,spec}.ts\" --create --keep-structure --update-ids", Its not updating refurbished/new test script code into testomat. It shows the older version of code while seeing the reports. For that, We have to add a script under the folder with all the details.

[poliarush]

@manjeetkiwiqa you have unmatched tests, you need to have it matched first by check-tests command

did you synced all tests before?

or if you're using reporter you can crate unmatched tests on the fly (which is clearly stated in the message in first screenshot)

https://docs.testomat.io/reference/reporter/pipes/testomatio.html#create-unmatched-tests

Create Unmatched Tests Testomat.io will not create tests from the report if they have not been previously imported. To create tests during the report TESTOMATIO_CREATE option can be used:

TESTOMATIO={API_KEY} TESTOMATIO_CREATE=1 <actual run command>

[olexandr13]

Rechecked test code update - works fine for me. @manjeetkiwiqa please add more details about your issue.

[poliarush]

@manjeetkiwiqa please retest it and re-open it if still reproduced