gurock / trcli

TR CLI (trcli) is a command line tool for interacting with TestRail.
Mozilla Public License 2.0
48 stars 39 forks source link

Unable to upload file that contain test cases that already exist in the same TestRail suite #194

Closed sampson-automation closed 6 months ago

sampson-automation commented 6 months ago

TestRail CLI Version

1.7.0

CLI Environment

MacOS Sonoma 14.1.1; Python 3.11.6; Playwright 1.39.0

TestRail Version

8.0.2 Default (3138)

TestRail Instance Type

Enterprise Cloud

Current behavior

After running a suite of tests and successfully uploading the junit-report.xml file, attempting to upload the same suite for a new run yields an error (attached). Argument --case-matcher auto is being leveraged as a part of the trcli command

Screenshot 2023-12-14 at 8 59 00 PM

Desired behavior

When uploading a file that has a test suite that contains test cases that have already been upload to process and present additional runs, add any new test cases that do not exist in the suite already and ignore test cases that already exist within TestRail.

More Details

Side note:

sampson-automation commented 6 months ago

Made some adjustments to the TestRail instance and it seemed to do the trick. We recreated the automation_id in TestRail admin as a string instead of a text field and I can now upload junit-report.xml result files with the same tests without error, them being duplicated in the suite and the suite not being duplicated.