Closed sampson-automation closed 6 months ago
Made some adjustments to the TestRail instance and it seemed to do the trick. We recreated the automation_id
in TestRail admin as a string
instead of a text
field and I can now upload junit-report.xml result files with the same tests without error, them being duplicated in the suite and the suite not being duplicated.
TestRail CLI Version
1.7.0
CLI Environment
MacOS Sonoma 14.1.1; Python 3.11.6; Playwright 1.39.0
TestRail Version
8.0.2 Default (3138)
TestRail Instance Type
Enterprise Cloud
Current behavior
After running a suite of tests and successfully uploading the junit-report.xml file, attempting to upload the same suite for a new run yields an error (attached). Argument
--case-matcher auto
is being leveraged as a part of thetrcli
commandDesired behavior
When uploading a file that has a test suite that contains test cases that have already been upload to process and present additional runs, add any new test cases that do not exist in the suite already and ignore test cases that already exist within TestRail.
More Details
Side note:
<testsuites>
tag in the junit-report.xml file usingPLAYWRIGHT_JUNIT_SUITE_NAME=<suitename>
as a part of my command line run ofnpx playwright test
trcli
also do not yield the desired result. It either dupes the suite or test cases in suite.case-fields
don't appear to pass their value into the newly created test cases uploaded