gurock / trcli

TR CLI (trcli) is a command line tool for interacting with TestRail.
Mozilla Public License 2.0
48 stars 39 forks source link

--case-fields not working when I attempt to push data to some of the fields (i.e. Type, custom-field in Testrail ) #205

Closed jayslbrte closed 4 months ago

jayslbrte commented 4 months ago

TestRail CLI Version

8.0.3

CLI Environment

No response

TestRail Version

8.0.3

TestRail Instance Type

Professional Cloud

Current behavior

--case-fields not working when I attempt to push data to some of the fields (i.e. Type, custom-field in Testrail )

TRcli is not pushing data to my case fields like it should do --case-fields "automation_status:Automated" \ --case-fields "type:Integration Test" \

Desired behavior

I want to push data to my case fields together with the results from junit I want below --case-fields "automation_status:Automated" \ --case-fields "type:Integration Test" \

More Details

No response

bitcoder commented 4 months ago

Hi @jayslbrte ,

  1. can you please provide a sample of the JUnit XML report you're submitting and the exact command line?
  2. can you also detail the type of these fields on TestRail?
jayslbrte commented 4 months ago

1. JunitXML report

  <testsuite name="Sample.Tests.dll" tests="4" skipped="0" failures="1" errors="0" time="0.5011519" timestamp="2024-02-06T03:33:23" hostname="XXXXXX" id="0" package="XXXXXXX">
    <properties />
    <testcase classname="Sample.Tests.V1.Forms.Validators.CreateFormRequestValidatorTests" name="Sample.Tests.V1.Forms.Validators.CreateFormRequestValidatorTests.GivenValidDetails_WhenValidatingForm_ThenNoErrors" time="0.0450940">
      <failure type="failure" message="System.Exception : I am an issue">at Sample.Tests.V1.Forms.Validators.CreateFormRequestValidatorTests.GivenValidDetails_WhenValidatingForm_ThenNoErrors() in /Users/XXXXX/Work/Code/Tests/V1/Forms/Validators/CreateFormRequestValidatorTests.cs:line 1</failure>
    </testcase>
    <testcase classname="Sample.Tests.V1.Forms.Validators.CreateFormRequestValidatorTests" name="Sample.Tests.V1.Forms.Validators.CreateFormRequestValidatorTests.GivenEmptyString_WhenValidatingName_ThenMandatoryErrorForName(&quot;&quot;)" time="0.1520220" />.....

2.the type of these fields on TestRail?

image image

Testinator-X commented 4 months ago

What is the exact command you are using for the import? What error message do you get exactly?

Spontaneously I notice that automation_status seems to be a custom case field, so the --case-fields should probably be "custom_automation_status" instead of just "automation_status" and the ID should be provided as Integer. --> e.g. --case-fields custom_automation_status:1 while 1 is the individual integer of the status name you would like to use.

chrome_dmuPuxGGdq chrome_Yi0NXMWhMv

as far as the custom case type is concerned, I'm not sure whether you can specify it at all. But if you can, then probably also with the integer value of the ID instead of the user-readable name. I would try it with --case-fields type_id:1 while 1 is the individual integer of the type you would like to use.

gmTNUS6zfJ

jayslbrte commented 4 months ago

@Testinator-X , Thank you for your help. it works using: --case-fields "custom_automation_status:2" \ --case-fields "type_id:14"

bitcoder commented 4 months ago

thanks I'll close this after reviewing current docs

jayslbrte commented 4 months ago

@bitcoder @Testinator-X is there a way trcli can allow you to organise your new test cases by it creating new test folders using testcase names instead testsuite name?

<testsuites>
  <testsuite name="Tests.suite" tests="4" skipped="0" failures="1" errors="0"
  <testcase classname="Tests.V1.Validators.CreateRequest" name="Tests.V1.Validators.CreateRequest.GivenCoolString_WhenValidatingName_ThenMandatoryErrorForName(....
  <testcase classname="Tests.V1.Validators.CreateRequest" name="Tests.V1.Validators.CreateRequest....
  <testcase classname="Tests.V1.Validators.CreateRequest" name="Tests.V1.Validators.CreateRequest....
  <testcase classname="Tests.V1.Validators.CreateRequest" name="Tests.V1.Validators.CreateRequest....
bitcoder commented 4 months ago

That's non configurable