zinserjan / wdio-visual-regression-service

Visual regression service for WebdriverIO.
MIT License
102 stars 39 forks source link

Mismatch Tolerance doesn't appear to work #104

Open nijk opened 4 years ago

nijk commented 4 years ago

When using misMatchTolerance in config I'm still seeing errors reported for mismatches below the tolerance threshold:

Config

{
  visualRegression: {
    compare: new VisualRegressionCompare.LocalCompare({
      referenceName: ...
      screenshotName: ...
      diffName: ...
      misMatchTolerance: 0.1,
    }),
    viewportChangePause: 500,
    orientations: ['portrait'],
  },
}

Test output

Error: Screenshots mismatched by 0.04%

It appears that misMatchTolerance is not working, can anyone confirm this?