kobenguyent / codeceptjs-rphelper

4 stars 23 forks source link

Random test assertEqual failure keeps test "in progress" after execution #31

Closed mtrejo-evgo closed 4 months ago

mtrejo-evgo commented 4 months ago

The local test execution completes but on report portal the test run stays in progress with one test that looks like it didn't complete. The test completed and has a failure on a assertEqual (chai wrapper). When I fix the test failure, it jumps to another test failure with an assertEqual fail and keeps it "in progress".

I.assertEqual(400, 202)

Screenshot 2024-05-14 at 10 11 39 AM
kobenguyent commented 4 months ago

Hey @mtrejo-evgo may you give it a try with CodeceptJS helper https://codecept.io/helpers/Expect/ it's pretty much the same with chai expect I think.

mtrejo-evgo commented 4 months ago

Hey @kobenguyent, I switched to the expect helper but I still see the "in progress" issue.

kobenguyent commented 4 months ago

@mtrejo-evgo would you mind sharing the logs so we could look into it?

plugins: { reportportal: { require: 'codeceptjs-rphelper', token: 'YOUR_TOKEN', endpoint: 'http://localhost:8080/api/v1', launchName: 'This is awesome', launchDescription: 'This is a description of your launch', launchAttributes: [{ key: 'yourKey', value: 'yourValue' }], projectName: 'YOUR_PROJECT', rerun: false, debug: true,// set this to true enabled: true }

mtrejo-evgo commented 4 months ago

Hey @kobenguyent ,

here you are

`Success start item with tempId abcd { id: 'REDACTED', uniqueId: 'REDACTED' }

Finish test item with tempId abcd { promiseStart: Promise { { id: 'REDACTED’, uniqueId: 'REDACTED' } }, realId: 'REDACTED', children: [], finishSend: true, promiseFinish: Promise { }, resolveFinish: [Function (anonymous)], rejectFinish: [Function (anonymous)] }

Start test item with tempId abcd { startTime: 1715791210362, name: ❌ [STEP]: I assertContain "\\"invalid type for variable: 'input'\\" \\"Variable \\\\\\"$input\\\\\\" got invalid value { id: \\\\\\"REDACTED”, type: 'STEP', codeRef: As a guest user I am able to search/❌ [STEP]: I assertContain "\\"invalid type for variable: 'input'\\" \\"Variable \\\\\\"$input\\\\\\" got invalid value { id: \\\\\\"REDACTED”, testCaseId: As a guest user I am able to search/❌ [STEP]: I assertContain "\\"invalid type for variable: 'input'\\" \\"Variable \\\\\\"$input\\\\\\" got invalid value { id: \\\\\\"REDACTED”, hasStats: false, launchUuid: 'REDACTED' }

Finish all children for test item with tempId abcd

Finish test item with tempId abcd { endTime: 1715791210354, status: 'passed' }`

kobenguyent commented 4 months ago

:tada: This issue has been resolved in version 3.3.6 :tada:

The release is available on:

Your semantic-release bot :package::rocket: