serenity-bdd / serenity-cucumber

Cucumber integration for the Serenity BDD Reporting library
Other
78 stars 74 forks source link

Running in parallel will not execute tagged Examples if specifying the tag directly #213

Open nkilin opened 4 years ago

nkilin commented 4 years ago

Preconditions:

  1. clone https://github.com/serenity-bdd/serenity-cucumber.git
  2. use latest serenity versions in: src/smoketests/pom.xml
    <serenity.version>2.0.70</serenity.version>
    <serenity.cucumber.version>1.9.45</serenity.cucumber.version>
  3. from src/smoketests run in parallel the Examples tagged @single_red: mvn clean verify -PuseTheForks -Dcucumber.options="--tags '@single_red'"

Notice that the test will not be picked up, the serenity report will be blank. Now here comes the fun part, try to run it like this: mvn clean verify -PuseTheForks -Dcucumber.options="--tags '@tag_test and not @double_blue'" Notice that if using the reverse logic to identify the Examples in that case the tests will run.

By the looks of it, this behavior doesn't seem intended. Since if running single threaded the Examples are picked up properly: mvn clean verify -PdontUseTheForks -Dcucumber.options="--tags '@single_red'"

wakaleo commented 4 years ago

Table-level tags are not currently supported in Serenity