getgauge / taiko

A node.js library for testing modern web applications
https://taiko.dev
MIT License
3.55k stars 450 forks source link

Should be able to run scripts in parallel on Mac #300

Closed NivedhaSenthil closed 5 years ago

NivedhaSenthil commented 5 years ago

Expected behavior

Run https://github.com/getgauge-examples/js-taiko specs in parallel on Mac without error

Actual behavior

Steps timeout.

NivedhaSenthil commented 5 years ago

Tried multiple things like downgrading, upgrading chromium version and other dependencies. Launching chromium with suggested command line args and increasing max memory using --max_old_space_size=4096 but nothing seems to help.

NivedhaSenthil commented 5 years ago

seems to happen when run serially sometimes too https://build.gauge.org/go/pipelines/Taiko/442/functional-tests/4, one thing which was causing flakiness was the size of iframes in the test, since it was very small page's scrollHeight became long causing firstMeaningfulPaint event to get triggered after a long time. Updating the size helped to minimise the flakiness, still seems to happen occasionally. Suspected mac firewall, even turning it off dint affect it.

NivedhaSenthil commented 5 years ago

one observation is that the test suite works runs fine in parallel when run in headful mode but times out when run in headless mode. Need to investigate if its an upstream bug

NivedhaSenthil commented 5 years ago

Works fine with fix ef48f7b