webdriverio-boneyard / wdio-cucumber-framework

A WebdriverIO v4 plugin. Adapter for Cucumber testing framework.
MIT License
77 stars 61 forks source link

Skipped scenarios - if one fails the rest got skipped #157

Closed AlinaVasylieva closed 5 years ago

AlinaVasylieva commented 5 years ago

Hey guys! Currently faced the situation that if one of the scenarios fails the ongoing scenarios in the same feature file are skipped.

Using: "wdio-cucumber-framework": "^1.1.0", "webdriverio": "^4.13.2"

I have looked through all possible documentation, but haven't found any solution, nor the proof that this kind of behaviour is normal, could you please advise? Have you faced this before?

BorisOsipov commented 5 years ago

Have you faced this before?

no. Can you share some example repo on github? Also some logs how it looks like will be helpful

woolter commented 5 years ago

@AlinaVasylieva what is the specific version that you are using?

I'm using: wdio-cucumber-framework@2.2.8 webdriverio@4.14.1

And I don't have this problem

AlinaVasylieva commented 5 years ago

@BorisOsipov I will try to prepare the example solution and provide log! Thanks for taking a look!

@woolter I have tried your versions - same situation with the slight difference! Before setting up your versions statically if one scenario was failing the ongoing one was not even stated for execution, thus for example as the result I see - 13 passed, 1 failed, 3 pending, even though, I have the ongoing scenario with 17 steps more.

image image

When I set your versions statically - my second scenario is still skipped, but now I see those steps as pending: image image image

What I'm trying to understand if the second scenario should be executed by default? Or I need any specific configuration?

woolter commented 5 years ago

What I'm trying to understand if the second scenario should be executed by default? Or I need any specific configuration?

Yes the second scenario should be executed by default

@AlinaVasylieva can you share your cucumberOpts?

cucumberOpts: {
    "require": ["./src/support/setup.js", "./src/step_definitions/*"],
    "backtrace": false,
    "compiler": ["js:babel-register"],
    "dryRun": false,
    "failFast": false,
    "format": ["pretty"],
    "colors": true,
    "snippets": true,
    "source": true,
    "profile": [],
    "strict": false,
    "tags": "",
    "timeout": 1000,
    "ignoreUndefinedDefinitions": false,
  },
AlinaVasylieva commented 5 years ago

@woolter Here're mine:

cucumberOpts: {
    require: ['./src/steps/*'],
    backtrace: true,  
    compiler: [ 'js:babel-register'],
    dryRun: false,      
    failFast: true,    
    format: ['summary'],
    colors: true,      
    snippets: true,     
    source: true,       
    profile: [],        
    strict: true,     
    tagsInTitle: true,
    tags: [],          
    timeout: 60000,    
    ignoreUndefinedDefinitions: false, 
  },
BorisOsipov commented 5 years ago

@AlinaVasylieva set failFast: false and try again.

AlinaVasylieva commented 5 years ago

@BorisOsipov worked! Thank you s much guys for your help! @woolter

BorisOsipov commented 5 years ago

Ok close then