search

sitespeedio / browsertime

Measure and Optimize Web Performance
https://www.sitespeed.io/documentation/browsertime/
Apache License 2.0
608 stars 137 forks source link

Firefox 121 on Mac OS (14.2) fails to start #2041

Closed soulgalore closed 10 months ago

soulgalore commented 10 months ago

It's the same on M1 and old AMD.

bin/browsertime.js https://wwww.sitespeed.io -b firefox -n 1
[2023-12-20 04:55:26] INFO: Running tests using Firefox - 1 iteration(s)
[2023-12-20 04:55:27] INFO: firefox failed to start, trying 2 more time(s): Process unexpectedly closed with status signal
[2023-12-20 04:55:27] INFO: firefox failed to start, trying 1 more time(s): Process unexpectedly closed with status signal
[2023-12-20 04:55:27] INFO: firefox failed to start, trying 0 more time(s): Process unexpectedly closed with status signal

Running on Ubuntu seems to work fine.

From Geckodriver:

1703046910184   geckodriver INFO    Listening on 127.0.0.1:52620
1703046910195   webdriver::server   DEBUG   -> GET /status 
1703046910195   webdriver::server   DEBUG   <- 200 OK {"value":{"message":"","ready":true}}
1703046910209   webdriver::server   DEBUG   -> POST /session {"capabilities":{"firstMatch":[{}],"alwaysMatch":{"browserName":"firefox","pageLoadStrategy":"none","moz:fir ... ry":"/Applications/Firefox.app/Contents/MacOS/firefox-bin","args":["-no-remote","-devtools"],"env":{}},"webSocketUrl":true}}}
1703046910211   geckodriver::capabilities   DEBUG   Trying to read firefox version from ini files
1703046910213   geckodriver::capabilities   DEBUG   Found version 121.0
1703046910214   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/chrome/
1703046910214   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/extensions/
1703046910214   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/chrome/userChrome.css
1703046910214   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/extensions/harexporttrigger@getfirebug.com.xpi
1703046910214   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/extensions/browsertime-extension@sitespeed.io.xpi
1703046910214   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/cert9.db
1703046910215   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/key4.db
1703046910220   mozrunner::runner   INFO    Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" MOZ_NO_REMOTE="1" "/App ... te-allow-hosts" "localhost" "-foreground" "-profile" "/var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU"
1703046910324   geckodriver::marionette DEBUG   Waiting 60s to connect to browser on 127.0.0.1
1703046910324   geckodriver::browser    TRACE   Failed to open /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofile5FLLGU/MarionetteActivePort
1703046910324   geckodriver::marionette TRACE   Retrying in 100ms
1703046910429   geckodriver::browser    DEBUG   Browser process stopped: signal: 9 (SIGKILL)
1703046910431   webdriver::server   DEBUG   <- 500 Internal Server Error {"value":{"error":"unknown error","message":"Process unexpectedly closed with status signal","stacktrace":""}}
[2023-12-20 05:35:10] INFO: [browsertime] firefox failed to start, trying 2 more time(s): Process unexpectedly closed with status signal
[2023-12-20 05:35:10] DEBUG: [browsertime.firefox] Set Firefox preference []
1703046910443   geckodriver INFO    Listening on 127.0.0.1:52623
1703046910454   webdriver::server   DEBUG   -> GET /status 
1703046910454   webdriver::server   DEBUG   <- 200 OK {"value":{"message":"","ready":true}}
1703046910480   webdriver::server   DEBUG   -> POST /session {"capabilities":{"firstMatch":[{}],"alwaysMatch":{"browserName":"firefox","pageLoadStrategy":"none","moz:fir ... ry":"/Applications/Firefox.app/Contents/MacOS/firefox-bin","args":["-no-remote","-devtools"],"env":{}},"webSocketUrl":true}}}
1703046910482   geckodriver::capabilities   DEBUG   Trying to read firefox version from ini files
1703046910482   geckodriver::capabilities   DEBUG   Found version 121.0
1703046910483   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/chrome/
1703046910483   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/extensions/
1703046910483   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/chrome/userChrome.css
1703046910483   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/extensions/harexporttrigger@getfirebug.com.xpi
1703046910483   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/cert9.db
1703046910484   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/extensions/browsertime-extension@sitespeed.io.xpi
1703046910484   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/key4.db
1703046910491   mozrunner::runner   INFO    Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" MOZ_NO_REMOTE="1" "/App ... te-allow-hosts" "localhost" "-foreground" "-profile" "/var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i"
1703046910496   geckodriver::marionette DEBUG   Waiting 60s to connect to browser on 127.0.0.1
1703046910496   geckodriver::browser    TRACE   Failed to open /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofilepG1i0i/MarionetteActivePort
1703046910496   geckodriver::marionette TRACE   Retrying in 100ms
1703046910601   geckodriver::browser    DEBUG   Browser process stopped: signal: 9 (SIGKILL)
1703046910602   webdriver::server   DEBUG   <- 500 Internal Server Error {"value":{"error":"unknown error","message":"Process unexpectedly closed with status signal","stacktrace":""}}
[2023-12-20 05:35:10] INFO: [browsertime] firefox failed to start, trying 1 more time(s): Process unexpectedly closed with status signal
[2023-12-20 05:35:10] DEBUG: [browsertime.firefox] Set Firefox preference []
1703046910610   geckodriver INFO    Listening on 127.0.0.1:52626
1703046910622   webdriver::server   DEBUG   -> GET /status 
1703046910622   webdriver::server   DEBUG   <- 200 OK {"value":{"message":"","ready":true}}
1703046910641   webdriver::server   DEBUG   -> POST /session {"capabilities":{"firstMatch":[{}],"alwaysMatch":{"browserName":"firefox","pageLoadStrategy":"none","moz:fir ... ry":"/Applications/Firefox.app/Contents/MacOS/firefox-bin","args":["-no-remote","-devtools"],"env":{}},"webSocketUrl":true}}}
1703046910643   geckodriver::capabilities   DEBUG   Trying to read firefox version from ini files
1703046910643   geckodriver::capabilities   DEBUG   Found version 121.0
1703046910644   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/chrome/
1703046910644   geckodriver::capabilities   DEBUG   Creating profile directory tree /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/extensions/
1703046910644   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/extensions/browsertime-extension@sitespeed.io.xpi
1703046910644   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/extensions/harexporttrigger@getfirebug.com.xpi
1703046910644   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/chrome/userChrome.css
1703046910644   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/cert9.db
1703046910645   geckodriver::capabilities   DEBUG   Extracting profile to /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/key4.db
1703046910651   mozrunner::runner   INFO    Running command: MOZ_CRASHREPORTER="1" MOZ_CRASHREPORTER_NO_REPORT="1" MOZ_CRASHREPORTER_SHUTDOWN="1" MOZ_NO_REMOTE="1" "/App ... te-allow-hosts" "localhost" "-foreground" "-profile" "/var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE"
1703046910656   geckodriver::marionette DEBUG   Waiting 60s to connect to browser on 127.0.0.1
1703046910656   geckodriver::browser    TRACE   Failed to open /var/folders/jx/m9wvcdl12kx2dt9dznxjt3mr0000gn/T/rust_mozprofileWWf4HE/MarionetteActivePort
1703046910656   geckodriver::marionette TRACE   Retrying in 100ms
1703046910761   geckodriver::browser    DEBUG   Browser process stopped: signal: 9 (SIGKILL)
1703046910762   webdriver::server   DEBUG   <- 500 Internal Server Error {"value":{"error":"unknown error","message":"Process unexpectedly closed with status signal","stacktrace":""}}
soulgalore commented 10 months ago

Tried to reproduce using mozrgression but there it works. Documenting here though if I need to do it again:

mozregression --good 120.0 --bad 121.0 -c "/PATH/browsertime/bin/browsertime.js -b firefox https://www.wikipedia.org -n 1 --firefox.binaryPath {binary}"

soulgalore commented 10 months ago

Released a fix where we set the firefox binary.