gurock / trcli

TR CLI (trcli) is a command line tool for interacting with TestRail.
Mozilla Public License 2.0
48 stars 39 forks source link

TRCli - Test Suite Named - io.cucumber.core.plugin.JUnitFormatter is considered while adding tests to Test Rail #179

Closed sjoshidw closed 6 months ago

sjoshidw commented 8 months ago

TestRail CLI Version

1.6.1

CLI Environment

Windows 10, Python 3.11.5

TestRail Version

TestRail v8.0.1 Default (1033)

TestRail Instance Type

Professional Cloud

Current behavior

We are using TrCli utility - https://github.com/gurock/trcli to upload our tests via jenkins pipeline scripts or local results via following command -

trcli --insecure --verbose -y -c "testrailconfig.yaml" parse_junit -f "./test-output/junitreports/TEST-runner.runner.xml" --suite-name "tests.LoginTests"

I had followed your documentation where there is a option of providing --suite-name but it can replace the test suite name and class but We need to change the test suite root name of junit file - which is right now Junit generated file is "io.cucumber.core.plugin.JUnitFormatter"

Desired behavior

Can TRCLi provide any option to customize this root test suite? because of this, we are getting unnecessary sections created on the test rail project which require attention.

More Details

Junit file (see image)-

image

Test Rail Config contains see image: image

Testinator-X commented 8 months ago

The latest version of trcli is v1.6.2. Does the problem also occur with this version?

sjoshidw commented 8 months ago

Thanks for the response, I have upgraded pip package to v1.6.2 issue still persistent under Test Cases section -

image
bitcoder commented 7 months ago

@sjoshidw, can you please clarify some points?

  1. is your target project of type "single repository" or "multiple suite"?
  2. how many sections do you get created in TestRail? Just one right? (i.e., "io.cucumber.core.plugin.JUnitFormatter")?
  3. the section(s) that was/were created is/are empty? or do they have test cases within them?
  4. if I got you correctly, what you would like to have would be a way to define the name of the section where those tests should be added to in TestRail, right? what exactly would you like to have in TestRail side?
sjoshidw commented 7 months ago
  1. is your target project of type "single repository" or "multiple suite"?

Sharvil: multiple

  1. how many sections do you get created in TestRail? Just one right? (i.e., "io.cucumber.core.plugin.JUnitFormatter")?

Sharvil: yes one extra with above name

  1. the section(s) that was/were created is/are empty? or do they have test cases within them?

Sharvil: just folder not tcs

  1. if I got you correctly, what you would like to have would be a way to define the name of the section where those tests should be added to in TestRail, right? What exactly would you like to have in the TestRail side?

Sharvil: I tried to explain in my first note- it will be great if test rail config can drive it

On Wed, Dec 6, 2023 at 8:02 PM Sergio Freire @.***> wrote:

@sjoshidw https://github.com/sjoshidw, can you please clarify some points?

  1. is your target project of type "single repository" or "multiple suite"?
  2. how many sections do you get created in TestRail? Just one right? (i.e., "io.cucumber.core.plugin.JUnitFormatter")?
  3. the section(s) that was/were created is/are empty? or do they have test cases within them?
  4. if I got you correctly, what you would like to have would be a way to define the name of the section where those tests should be added to in TestRail, right? what exactly would you like to have in TestRail side?

— Reply to this email directly, view it on GitHub https://github.com/gurock/trcli/issues/179#issuecomment-1843004200, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6QIKKIYBOIQ3WTZ43DHNUDYIB6X5AVCNFSM6AAAAAA7AWD4YGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBTGAYDIMRQGA . You are receiving this because you were mentioned.Message ID: @.***>

bitcoder commented 7 months ago

Thank for the feedback. v1.6.3 was just released. Can you please try it and share what is now the behaviour we get? As there was a minor change.

sjoshidw commented 7 months ago

Okay thanks for updates, will get back!

On Thu, Dec 7, 2023 at 5:34 PM Sergio Freire @.***> wrote:

Thank for the feedback. v1.6.3 was just released. Can you please try it and share what is now the behaviour we get? As there was a minor change.

— Reply to this email directly, view it on GitHub https://github.com/gurock/trcli/issues/179#issuecomment-1845223654, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6QIKKPABXMUHLUVJ6I66PDYIGWFXAVCNFSM6AAAAAA7AWD4YGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNBVGIZDGNRVGQ . You are receiving this because you were mentioned.Message ID: @.***>

bitcoder commented 6 months ago

@sjoshidw were you able to have a look at this?

bitcoder commented 6 months ago

Any feedback please? Or else I'll close the issue assuming it was implicitly fixed

sjoshidw commented 6 months ago

I was on planned leaves, let me see in the next 24 hours! Thanks!

On Mon, Dec 18, 2023 at 3:48 PM Sergio Freire @.***> wrote:

Any feedback please? Or else I'll close the issue assuming it was implicitly fixed

— Reply to this email directly, view it on GitHub https://github.com/gurock/trcli/issues/179#issuecomment-1860026755, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6QIKKILU4TYDK6OSAM6MMDYKAJ7TAVCNFSM6AAAAAA7AWD4YGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRQGAZDMNZVGU . You are receiving this because you were mentioned.Message ID: @.***>

bitcoder commented 6 months ago

Any news @sjoshidw ? Meanwhile we just released v1.8.0 btw

bitcoder commented 6 months ago

@sjoshidw happy new year first of all :) Any news on this topic?

bitcoder commented 6 months ago

I'm closing this issue for lack of feedback. If the problem arises, please raise a new issue