browserstack / karma-browserstack-example

4 stars 18 forks source link

Test are not running stable, get time-outs after a few runs #8

Open Borewit opened 4 years ago

Borewit commented 4 years ago

Test are not running stable, after a few runs I get:

Chrome 72.0.3626 (Windows 10.0.0): Executed 1 of 1 (1 FAILED) ERROR (0.011 secs / 0.003 secs)
28 01 2020 21:30:27.746:WARN [launcher.browserstack]: iPhone X (ios 11.0) has not captured in 60000 ms, killing.
28 01 2020 21:30:30.560:INFO [launcher.browserstack]: iPhone X (ios 11.0) session at https://automate.browserstack.com/builds/02dc53e3d23e77aea2dfccd7335b4cd9f40385f0/sessions/39b203ac5f76f266a6a2efaaf21969c2ae4dc3b5
28 01 2020 21:31:32.014:WARN [launcher.browserstack]: iPhone X (ios 11.0) has not captured in 60000 ms, killing.
28 01 2020 21:31:36.628:INFO [launcher.browserstack]: iPhone X (ios 11.0) session at https://automate.browserstack.com/builds/02dc53e3d23e77aea2dfccd7335b4cd9f40385f0/sessions/ec4093797f0cbdee9285775a64fe6a3e2a89e52a
28 01 2020 21:32:39.474:WARN [launcher.browserstack]: iPhone X (ios 11.0) has not captured in 60000 ms, killing.
28 01 2020 21:32:42.375:INFO [launcher.browserstack]: iPhone X (ios 11.0) session at https://automate.browserstack.com/builds/02dc53e3d23e77aea2dfccd7335b4cd9f40385f0/sessions/f5efbf40fb80956d1409d8e5bda421415cf886ff
28 01 2020 21:33:43.810:WARN [launcher.browserstack]: iPhone X (ios 11.0) has not captured in 60000 ms, killing.

Updated customLaunchers in karma.conf.js with:

customLaunchers: {
      bs_chrome_windows: {
        base: 'BrowserStack',
        browser: 'chrome',
        browser_version: '72.0',
        os: 'Windows',
        os_version: '10'
      },

      bs_iphoneX: {
        base: 'BrowserStack',
        device: 'iPhone X',
        os: 'ios',
        real_mobile: true,
        os_version: '11.0'
      }
    }

Maybe caused by: karma-runner/karma-browserstack-launcher#152

I experience the same in:

RohanImmanuel commented 4 years ago

@Borewit the timeouts and browser profiles have been updated

https://github.com/browserstack/karma-browserstack-example/blob/master/karma.conf.js#L77-L92

XhmikosR commented 4 years ago

@RohanImmanuel We are also hitting this issue for months. Today I pushed a few patches which make use of your suggested karma config and also updated to the latest karma-browserstak-launcher, but we still get failures. Maybe less frequently, but they still happen.

Our karma config can be found here: https://github.com/twbs/bootstrap/blob/master/js/tests/karma.conf.js

The issue arises when we push too many stuff, too fast. Would be nice if we could solve this once and for all 🙂