What would you like the TestRail CLI to be able to do?
I am having issues updating Test Cases that only exist in my Test Run in Test Rail. This was working awhile back for me, and I swore I tested this properly as the goal was to avoid the results being passed to add Test Cases to the existing Test Run. Or possibly something has changed since then.
Setup
Case IDs exists in all my Cypress Test Cases ( [C1234] as an example) to match the Case IDs in the Test Cases of Test Rail
I have a Test Plan, where a Test Run exists. I have only 3 Test Cases in this Test Run (R295)
The Cypress Folder I am specifically running has 10 Test Cases, where 3 of these exist in my Test Run in Test Rail
What is happening:
It seems to now add missing Tests (that exist on my report) to my Test Run, where I only want to update the 3 Test Cases that exist in my Test Run. I keep passing -n for no new test cases, but it keeps creating them.
This is what I execute below to pass the report into Test Rail.
Why is this feature necessary on the TestRail CLI?
Ideally we would like to run our Cypress Tests on a daily job, or execute manually when needed for QA, then upload the results in specific Test Runs in Test Rail. Test Cases exists already, but we don't want the Report we are passing to add additional Test Cases to the Test Runs. It should only update the results of the existing Test Cases in these Test Runs
What would you like the TestRail CLI to be able to do?
I am having issues updating Test Cases that only exist in my Test Run in Test Rail. This was working awhile back for me, and I swore I tested this properly as the goal was to avoid the results being passed to add Test Cases to the existing Test Run. Or possibly something has changed since then.
Setup
What is happening: It seems to now add missing Tests (that exist on my report) to my Test Run, where I only want to update the 3 Test Cases that exist in my Test Run. I keep passing -n for no new test cases, but it keeps creating them.
This is what I execute below to pass the report into Test Rail.
trcli -n -h https://mydomain.testrail.io/
--project "projectname" --username testrailuser --password testrailpassword parse_junit --case-matcher name --title "Test 1" --run-id 295 -f "cypress/report/junit-report.xml"
Why is this feature necessary on the TestRail CLI?
Ideally we would like to run our Cypress Tests on a daily job, or execute manually when needed for QA, then upload the results in specific Test Runs in Test Rail. Test Cases exists already, but we don't want the Report we are passing to add additional Test Cases to the Test Runs. It should only update the results of the existing Test Cases in these Test Runs
More details
No response
Interested in implementing it yourself?
Yes