codeceptjs / CodeceptJS

Supercharged End 2 End Testing Framework for NodeJS
http://codecept.io
MIT License
4.11k stars 722 forks source link

Chunk and grep could not configure together if running parallel #2462

Open hungdao-testing opened 4 years ago

hungdao-testing commented 4 years ago

What are you trying to achieve?

I am going to run parallel with scenarios marking tags. It helps me run regression partly for relevant features.

What do you get instead?

Nothing scheduled for execution

Provide console output if related. Use --verbose mode for more details. npx codeceptjs run-multiple regression -c ./configs/webdriver.conf.js --verbose

Nothing scheduled for execution

# paste output here

Provide test source code if related

const { setHeadlessWhen } = require("@codeceptjs/configure");
const SUT = require("./../SUT");

let config = {
  tests: SUT.testSpecFolder,
  output: SUT.outputFolder,
  include: {
    I: SUT.IObject,
    PageFactory: SUT.pageFactory, // factory pattern to handle pages and common components
  },
  bootstrap: SUT.bootstrapFile,
  mocha: {},
  name: "amazon",
  multiple: {
    regression: {
      // run all tests in chrome and firefox
      chunks: 2,
      browsers: ["chrome", "firefox"],

      grep: "@regression",
      outputName: "regression",
    },
    smoke: {
      // run all tests in chrome and firefox
      browsers: ["chrome"],
      grep: "@smoke",
      outputName: "smoke-chrome",
    },
  },
  plugins: {
    retryFailedStep: {
      enabled: true,
    },
    screenshotOnFail: {
      enabled: true,
    },
    allure: {
      enabled: true,
    },
    stepByStepReport: {
      enabled: false,
      output: SUT.outputFolder,
    },
    rerun: {
      // run 4 times until 1st success
      minSuccess: 1,
      maxReruns: 3,
    },
  },
};

module.exports = config;

Details

"dependencies": {
    "@codeceptjs/ui": "^0.3.8",
    "@wdio/selenium-standalone-service": "^5.11.2",
    "allure-commandline": "^2.13.0",
    "codeceptjs": "^2.6.5",
    "codeceptjs-chai": "^1.1.1",
    "dotenv": "^8.2.0",
    "googleapis": "^39.2.0",
    "playwright": "^1.1.1",
    "puppeteer": "^3.3.0",
    "rimraf": "^3.0.2"
  },
Vorobeyko commented 4 years ago

@hungdao-testing Why you not using workers instead multiple?

hungdao-testing commented 4 years ago

I would like to handle different configuration @Vorobeyko