testomatio / app

Testomat.io is a simplified test management system for your automated tests. Issues, project board & documentation. app.testomat.io
https://app.testomat.io
27 stars 2 forks source link

Label a git branch name from Continous Integration to a Testomat Test run and provide filter capablities based on the the git branch name #988

Open bt-jagababu opened 4 months ago

bt-jagababu commented 4 months ago

Is your feature request related to a problem? Please describe. I'm always frustrated when I can't differentiate a run from a stable branch or feature branch.

Describe the solution you'd like

tikolakin commented 4 months ago

But you already can do that when test run is created and labels assigned? Do you want it to be a default behaviour?

poliarush commented 4 months ago

@bt-jagababu you can actually set labels during a run and filter by labels after this

https://docs.testomat.io/reference/reporter/pipes/testomatio.html#assign-label-to-run

To assign a label to run, a label with scope runs must exist. Then a label can be passed via TESTOMATIO_LABEL variable:

TESTOMATIO={API_KEY} TESTOMATIO_LABEL=release <actual run command>

There is a way to pass a value to label via:

TESTOMATIO={API_KEY} TESTOMATIO_LABEL="module:checkout" <actual run command>

Or you can set multiple labels separating them with comma

TESTOMATIO={API_KEY} TESTOMATIO_LABEL="release,module:checkout" <actual run command>
bt-jagababu commented 4 months ago

Thanks for the suggestions @poliarush, @tikolakin and @TetianaKhomenko .

I have tried using the Labels the way you suggested. The labels have been tagged in the Test run but the values are not added in the filter list. Hence there is no way for me to filter it. Please see the screenshot. Please let me know if there is a workaround for the same.

image
tikolakin commented 4 months ago

Hi @bt-jagababu , you should make labels available in filters

image image
bt-jagababu commented 4 months ago

Hi @tikolakin , Yes its already done. The problem is the branch values are runtime generated that needs to get updated in the filter values.

image

DavertMik commented 4 months ago

@poliarush I agree we should label this automatically from our reporter I already thought about it, we should take this into the next sprint

tikolakin commented 4 months ago

well, I am quite happy not to have a branch name assigned automatically and have it as a new default behaviour. Quite often, a test code branch name isn't as important as a branch of an application under test I think what @bt-jagababu is trying to address here is that labels on FE are not showing values provided from reported (cli args)