search

webdriverio-boneyard / webdrivercss

Regression testing tool for WebdriverIO v4
http://webdriver.io
MIT License
616 stars 106 forks source link

WebdriverCss Baseline is not very stable. #169

Open aaronxiang0926 opened 7 years ago

aaronxiang0926 commented 7 years ago

We are implementing the webdrivercss+mocha to our project. and later we will put it on the jenkinks,

below is my observation:

we run the scripts on the same machine . but after several times .10%~20% the test will be failed because of little displacement . in fact there is no change between baseline and actual screenshot. so my question is that is there any way to increase the reliability and stability for the execution . as we will later runing the job on the Jenkins. and We will have one stable baseline for maintenance

dialog8 homepage case3_3_2_step4 1600px diff

SerkanSipahi commented 7 years ago

@aaronxiang0926 he had the same issue but with misMatchTolerance: 0.1 everything works fine...