gurock / trcli

TR CLI (trcli) is a command line tool for interacting with TestRail.
Mozilla Public License 2.0
48 stars 39 forks source link

Unable to update test results generated in junit format from Cypress in CircleCI #232

Open gjambaisivanandham opened 1 month ago

gjambaisivanandham commented 1 month ago

TestRail CLI Version

v1.9.5

CLI Environment

python:3.10.5

TestRail Version

8.0.3 Default (3070)

TestRail Instance Type

Enterprise Cloud

Current behavior

My team is generating test results using https://www.npmjs.com/package/cypress-circleci-reporter, we had tests run in parallel and a lot of tests had the same name, I updated all of it and all the test and test suite have unique name, however while processing the test result, trcli is running into below issue. The below issue happens even when I removed the parallelization and running only a subset of tests.

TestRail CLI v1.9.5
Copyright 2024 Gurock Software GmbH - www.gurock.com
Parser Results Execution Parameters
> Report file: /cypress/cypress-*.xml
> Config file: None
> TestRail instance: **************************** (user: *******************************)
> Project: Cypress Integration Tests
> Run title: Automated Cypress Tests from CircleCI workflow
> Update run: No
> Add to milestone: No
> Auto-create entities: True
Parsing JUnit report.
Processed 1 test cases in section cypress.
Processed 1 test cases in section cypress.
Processed 15 test cases in section cypress.
Checking project. Done.
Found 17 test cases not matching any TestRail case.
Error: Section duplicates detected in /cypress/cypress-*.xml. This will result to failure to upload all cases.

Exited with code exit status 1

I checked the generated xml and there are no duplicate test case name but not sure why I am seeing this issue.

Desired behavior

Process the results and update the test run

More Details

No response