DevExpress / testcafe

A Node.js tool to automate end-to-end web testing.
https://testcafe.io
MIT License
9.83k stars 673 forks source link

Test failures getting stuck and not generating test report #8322

Closed usmanm16 closed 3 weeks ago

usmanm16 commented 3 weeks ago

What is your Scenario?

I use this command testcafe -c 5 firefox:headless to run regression suite. I have about 200 test cases in regression suite. I am using "testcafe": "^3.6.2", "testcafe-blink-diff": "0.4.11", "testcafe-reporter-allure-expanded": "1.1.0", "testcafe-reporter-html": "^1.4.6",

I have tried both Firefox and and Chrome, same issue with both browsers.

What is the Current behavior?

Whenever i run regression suite, if any one of the test fails. It gets stuck, do not end execution after completing the job and do not generate test report. Because test report doesn't generate until execution complete.

What is the Expected behavior?

It should completed execution, it should take screenshot of all tests failed and generate test report.

What is the public URL of the test page? (attach your complete example)

https://www.clinicalkey.com/student/login

What is your TestCafe test code?

Any simple login and logout code. Same behaviour.

Your complete configuration file

{ "src": "testcafe/tests", "skipJsErrors": true, "disableNativeAutomation": "true", "screenshots": { "path": "testcafe/screenshots", "pathPattern": "$${DATE}_${TIME}/${TESTID}/${TEST}.png", "takeOnFails": true, "fullPage": true }, "reporter": { "name": "html", "output": "testcafe/reports/htmlReports/POMReports.html" } }

Your complete test report

Can't generate test report

Screenshots

In the screenshot test-1 is failed and doesn't display screenshot of failing page. In the screenshot test-7 is failed but do display screenshot of failing page. Screenshot 2024-10-29 at 11 56 52 AM

Steps to Reproduce

  1. Run regression suite headless mode
  2. If any test fails
  3. If i am using 5 concurrence, one with failure get stuck and i am down to 4. If one more test fails then i am down to 3 tabs.

TestCafe version

3.6.2

Node.js version

v21.6.1

Command-line arguments

testcafe -c 5 firefox:headless ./testcafe/tests/.test/.test.js --hostname localhost

Browser name(s) and version(s)

No response

Platform(s) and version(s)

No response

Other

No response

PavelMor25 commented 3 weeks ago

Duplicate https://github.com/DevExpress/testcafe/issues/8324