microsoft / playwright

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
https://playwright.dev
Apache License 2.0
67.18k stars 3.69k forks source link

chore(roll): roll Firefox Beta to r1466 #33653

Closed mxschmitt closed 1 week ago

github-actions[bot] commented 1 week ago

Test results for "tests others"

2 flaky :warning: [playwright-test] › ui-mode-test-ct.spec.ts:59:5 › should run component tests after editing test @frozen-time-runner-chromium-linux
:warning: [chromium-page] › page/page-event-request.spec.ts:110:3 › should report navigation requests and responses handled by service worker @realtime-time-library-chromium-linux

21157 passed, 508 skipped :heavy_check_mark::heavy_check_mark::heavy_check_mark:

Merge workflow run.

github-actions[bot] commented 1 week ago

Test results for "tests 1"

3 flaky :warning: [chromium-library] › library/popup.spec.ts:264:3 › should not throw when click closes popup @chromium-ubuntu-22.04-node18
:warning: [installation tests] › playwright-electron-should-work.spec.ts:31:5 › electron should work with special characters in path @package-installations-macos-latest
:warning: [playwright-test] › ui-mode-test-watch.spec.ts:145:5 › should watch all @windows-latest-node18-1

36926 passed, 650 skipped :heavy_check_mark::heavy_check_mark::heavy_check_mark:

Merge workflow run.

github-actions[bot] commented 1 week ago

Test results for "tests 2"

2 fatal errors, not part of any test 20 failed :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @channel-chromium-macos-latest :x: [chromium-library] › library/browsertype-connect.spec.ts:436:5 › run-server › should respect selectors @chrome-beta-macos-latest :x: [chromium-library] › library/browsertype-connect.spec.ts:481:5 › run-server › should not throw on close after disconnect @chrome-beta-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:456:7 › cli codegen › should --save-trace @chrome-beta-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:466:7 › cli codegen › should save assets via SIGINT @chrome-beta-macos-latest :x: [chromium-library] › library/proxy.spec.ts:63:3 › should work with IP:PORT notion @chrome-beta-macos-latest :x: [chromium-library] › library/proxy.spec.ts:93:11 › should proxy local network requests › by default › localhost @chrome-beta-macos-latest :x: [chromium-library] › library/proxy.spec.ts:93:11 › should proxy local network requests › by default › loopback address @chrome-beta-macos-latest :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @chrome-beta-macos-latest :x: [chromium-library] › library/browsertype-connect.spec.ts:667:5 › run-server › should fulfill with global fetch result @chrome-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:456:7 › cli codegen › should --save-trace @chrome-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:466:7 › cli codegen › should save assets via SIGINT @chrome-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-test.spec.ts:99:5 › should generate routeFromHAR with --save-har @chrome-macos-latest :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @chrome-macos-latest :x: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:456:7 › cli codegen › should --save-trace @msedge-beta-macos-latest :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @msedge-beta-macos-latest :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @msedge-dev-macos-latest :x: [chromium-page] › page/page-screenshot.spec.ts:283:5 › page screenshot › should work for canvas @msedge-macos-latest :x: [webkit-library] › library/tracing.spec.ts:432:14 › should produce screencast frames fit @webkit-macos-13-xlarge :x: [webkit-library] › library/tracing.spec.ts:432:14 › should produce screencast frames scale @webkit-macos-13-xlarge

102 flaky :warning: [chromium-library] › library/browsercontext-fetch.spec.ts:1229:3 › should work with connectOverCDP @channel-chromium-macos-latest
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:27:3 › should work when passing the proxy only on the context level @channel-chromium-macos-latest
:warning: [chromium-library] › library/browsertype-launch-server.spec.ts:90:5 › launch server › should fire close event @channel-chromium-macos-latest
:warning: [chromium-library] › library/har.spec.ts:82:3 › should have pages in persistent context @channel-chromium-macos-latest
:warning: [chromium-library] › library/video.spec.ts:581:5 › screencast › should capture static page in persistent context @smoke @channel-chromium-windows-latest
:warning: [chromium-library] › library/browsercontext-base-url.spec.ts:37:3 › should construct a new URL when a baseURL in browserType.launchPersistentContext is passed to page.goto @chrome-beta-macos-latest
:warning: [chromium-library] › library/browsercontext-fetch.spec.ts:1229:3 › should work with connectOverCDP @chrome-beta-macos-latest
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:27:3 › should work when passing the proxy only on the context level @chrome-beta-macos-latest
:warning: [chromium-library] › library/browsertype-connect.spec.ts:492:5 › run-server › should saveAs videos from remote browser @chrome-beta-macos-latest
:warning: [chromium-library] › library/browsertype-launch.spec.ts:133:3 › should allow await using @chrome-beta-macos-latest
:warning: [chromium-library] › library/chromium/chromium.spec.ts:151:15 › should close service worker together with the context @chrome-beta-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-test.spec.ts:88:5 › should not generate recordHAR with --save-har @chrome-beta-macos-latest
:warning: [chromium-library] › library/proxy.spec.ts:44:3 › should use proxy for second page @chrome-beta-macos-latest
:warning: [chromium-library] › library/proxy.spec.ts:93:11 › should proxy local network requests › by default › link-local @chrome-beta-macos-latest
:warning: [chromium-library] › library/video.spec.ts:209:5 › screencast › should continue recording main page after popup closes @chrome-beta-macos-latest
:warning: [chromium-library] › library/browser.spec.ts:54:5 › should dispatch page.on(close) upon browser.close and reject evaluate @chrome-macos-latest
:warning: [chromium-library] › library/browsercontext-base-url.spec.ts:37:3 › should construct a new URL when a baseURL in browserType.launchPersistentContext is passed to page.goto @chrome-macos-latest
:warning: [chromium-library] › library/browsercontext-fetch.spec.ts:1229:3 › should work with connectOverCDP @chrome-macos-latest
:warning: [chromium-library] › library/browsertype-connect.spec.ts:735:5 › run-server › setInputFiles should preserve lastModified timestamp @chrome-macos-latest
:warning: [chromium-library] › library/browsertype-launch-server.spec.ts:23:5 › launch server › should work @chrome-macos-latest
:warning: [chromium-library] › library/chromium/chromium.spec.ts:151:15 › should close service worker together with the context @chrome-macos-latest
:warning: [chromium-library] › library/global-fetch-cookie.spec.ts:263:1 › should override cookie from Set-Cookie header even if it expired @chrome-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-python-async.spec.ts:82:5 › should save the codegen output to a file if specified @chrome-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-python.spec.ts:78:5 › should save the codegen output to a file if specified @chrome-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-test.spec.ts:88:5 › should not generate recordHAR with --save-har @chrome-macos-latest
:warning: [chromium-library] › library/inspector/pause.spec.ts:23:3 › should resume when closing inspector @chrome-macos-latest
:warning: [chromium-library] › library/logger.spec.ts:19:3 › should log @smoke @chrome-macos-latest
:warning: [chromium-library] › library/proxy.spec.ts:31:3 › should use proxy @smoke @chrome-macos-latest
:warning: [chromium-library] › library/proxy.spec.ts:44:3 › should use proxy for second page @chrome-macos-latest
:warning: [chromium-library] › library/tracing.spec.ts:370:5 › should survive browser.close with auto-created traces dir @chrome-macos-latest
:warning: [chromium-library] › library/video.spec.ts:381:5 › screencast › should capture navigation @chrome-macos-latest
:warning: [chromium-library] › library/beforeunload.spec.ts:20:3 › should close browser with beforeunload page @chrome-windows-latest
:warning: [chromium-library] › library/inspector/cli-codegen-aria.spec.ts:77:7 › should update aria snapshot highlight @chromium-headed-windows-latest
:warning: [chromium-library] › library/locator-generator.spec.ts:476:5 › reverse engineer internal:has-text locators @chromium-headed-windows-latest
:warning: [chromium-library] › library/trace-viewer.spec.ts:1184:1 › should ignore 304 responses @chromium-headed-windows-latest
:warning: [chromium-library] › library/trace-viewer.spec.ts:1314:1 › should preserve noscript when javascript is disabled @chromium-headed-windows-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:206:1 › should reset mouse position @chromium-tip-of-tree-ubuntu-20.04--headed
:warning: [chromium-library] › library/inspector/cli-codegen-1.spec.ts:24:7 › cli codegen › should click @chromium-tip-of-tree-windows-latest
:warning: [chromium-library] › library/selector-generator.spec.ts:443:5 › selector generator › should ignore empty role for candidate consideration @chromium-tip-of-tree-windows-latest--headed
:warning: [firefox-library] › library/inspector/cli-codegen-3.spec.ts:171:7 › cli codegen › should generate frame locators (4) @firefox-beta-windows-latest
:warning: [firefox-library] › library/capabilities.spec.ts:252:3 › requestFullscreen @firefox-headed-macos-14-xlarge
:warning: [firefox-library] › library/video.spec.ts:381:5 › screencast › should capture navigation @firefox-headed-macos-14-xlarge
:warning: [firefox-library] › library/video.spec.ts:189:5 › screencast › should capture static page @firefox-headed-ubuntu-24.04
:warning: [firefox-library] › library/browsercontext-route.spec.ts:21:3 › should intercept @firefox-headed-windows-latest
:warning: [firefox-library] › library/client-certificates.spec.ts:294:3 › browser › should fail with no client certificates @firefox-headed-windows-latest
:warning: [firefox-library] › library/emulation-focus.spec.ts:25:3 › should think that all pages are focused @smoke @firefox-headed-windows-latest
:warning: [firefox-library] › library/inspector/cli-codegen-1.spec.ts:56:7 › cli codegen › should double click @firefox-headed-windows-latest
:warning: [firefox-library] › library/inspector/cli-codegen-2.spec.ts:456:7 › cli codegen › should --save-trace @firefox-headed-windows-latest
:warning: [firefox-library] › library/inspector/pause.spec.ts:108:5 › pause › should show source @firefox-headed-windows-latest
:warning: [firefox-library] › library/page-clock.spec.ts:282:3 › stubTimers › replaces global performance.timeOrigin @firefox-macos-14-large
:warning: [chromium-library] › library/beforeunload.spec.ts:20:3 › should close browser with beforeunload page @msedge-beta-macos-latest
:warning: [chromium-library] › library/browsercontext-base-url.spec.ts:37:3 › should construct a new URL when a baseURL in browserType.launchPersistentContext is passed to page.goto @msedge-beta-macos-latest
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:27:3 › should work when passing the proxy only on the context level @msedge-beta-macos-latest
:warning: [chromium-library] › library/browsertype-launch-server.spec.ts:57:5 › launch server › should default to random wsPath @msedge-beta-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:466:7 › cli codegen › should save assets via SIGINT @msedge-beta-macos-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-beta-ubuntu-20.04
:warning: [chromium-page] › page/page-history.spec.ts:94:3 › goBack/goForward should work with bfcache-able pages @msedge-beta-ubuntu-20.04
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:68:3 › should set cookie for top-level domain @msedge-beta-windows-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-beta-windows-latest
:warning: [chromium-library] › library/selector-generator.spec.ts:40:5 › selector generator › should prefer role=button over inner span @msedge-beta-windows-latest
:warning: [chromium-library] › library/browsercontext-base-url.spec.ts:37:3 › should construct a new URL when a baseURL in browserType.launchPersistentContext is passed to page.goto @msedge-dev-macos-latest
:warning: [chromium-library] › library/browsercontext-fetch.spec.ts:1229:3 › should work with connectOverCDP @msedge-dev-macos-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-dev-macos-latest
:warning: [chromium-library] › library/browsertype-connect.spec.ts:141:5 › launchServer › should be able to reconnect to a browser @msedge-dev-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:456:7 › cli codegen › should --save-trace @msedge-dev-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-2.spec.ts:466:7 › cli codegen › should save assets via SIGINT @msedge-dev-macos-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-dev-ubuntu-20.04
:warning: [chromium-library] › library/beforeunload.spec.ts:20:3 › should close browser with beforeunload page @msedge-macos-latest
:warning: [chromium-library] › library/browsercontext-fetch.spec.ts:1229:3 › should work with connectOverCDP @msedge-macos-latest
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:27:3 › should work when passing the proxy only on the context level @msedge-macos-latest
:warning: [chromium-library] › library/browsertype-connect.spec.ts:867:7 › run-server › socks proxy › should proxy based on the pattern @msedge-macos-latest
:warning: [chromium-library] › library/browsertype-launch-server.spec.ts:29:5 › launch server › should work with host @msedge-macos-latest
:warning: [chromium-library] › library/inspector/cli-codegen-csharp.spec.ts:171:5 › should work with --save-har @msedge-macos-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-ubuntu-20.04
:warning: [chromium-library] › library/browsercontext-proxy.spec.ts:264:3 › should isolate proxy credentials between contexts @msedge-windows-latest
:warning: [chromium-library] › library/browsercontext-reuse.spec.ts:30:1 › should re-add binding after reset @msedge-windows-latest
:warning: [chromium-library] › library/video.spec.ts:581:5 › screencast › should capture static page in persistent context @smoke @msedge-windows-latest
:warning: [firefox-library] › library/inspector/cli-codegen-3.spec.ts:171:7 › cli codegen › should generate frame locators (4) @tracing-firefox
:warning: [webkit-library] › library/browsercontext-viewport-mobile.spec.ts:157:5 › mobile viewport › mouse should work with mobile viewports and cross process navigations @tracing-webkit
:warning: [webkit-library] › library/inspector/cli-codegen-1.spec.ts:611:7 › cli codegen › should select @webkit-headed-macos-14-xlarge
:warning: [webkit-page] › page/page-request-fallback.spec.ts:221:5 › post data › should amend post data @webkit-headed-macos-14-xlarge
:warning: [webkit-library] › library/inspector/cli-codegen-1.spec.ts:238:7 › cli codegen › should not target selector preview by text regexp @webkit-headed-ubuntu-20.04
:warning: [webkit-library] › library/inspector/cli-codegen-3.spec.ts:527:7 › cli codegen › should generate getByLabel @webkit-headed-ubuntu-20.04
:warning: [webkit-library] › library/popup.spec.ts:115:3 › should inherit viewport size from browser context @webkit-headed-ubuntu-22.04
:warning: [webkit-library] › library/trace-viewer.spec.ts:911:1 › should show action source @webkit-headed-ubuntu-22.04
:warning: [webkit-library] › library/inspector/cli-codegen-3.spec.ts:686:7 › cli codegen › should assert value @webkit-headed-ubuntu-24.04
:warning: [webkit-library] › library/inspector/cli-codegen-aria.spec.ts:77:7 › should update aria snapshot highlight @webkit-headed-ubuntu-24.04
:warning: [webkit-library] › library/popup.spec.ts:115:3 › should inherit viewport size from browser context @webkit-headed-ubuntu-24.04
:warning: [webkit-library] › library/browsercontext-reuse.spec.ts:206:1 › should reset mouse position @webkit-headed-windows-latest
:warning: [webkit-library] › library/inspector/cli-codegen-1.spec.ts:24:7 › cli codegen › should click @webkit-headed-windows-latest
:warning: [webkit-library] › library/inspector/cli-codegen-1.spec.ts:541:7 › cli codegen › should check a radio button @webkit-headed-windows-latest
:warning: [webkit-library] › library/inspector/cli-codegen-1.spec.ts:579:7 › cli codegen › should uncheck @webkit-headed-windows-latest
:warning: [webkit-library] › library/inspector/cli-codegen-3.spec.ts:498:7 › cli codegen › should generate getByAltText @webkit-headed-windows-latest
:warning: [webkit-library] › library/inspector/cli-codegen-3.spec.ts:758:7 › cli codegen › should assert value on disabled select @webkit-headed-windows-latest
:warning: [webkit-library] › library/tracing.spec.ts:432:14 › should produce screencast frames crop @webkit-macos-13-xlarge
:warning: [webkit-library] › library/trace-viewer.spec.ts:1524:1 › canvas clipping @webkit-macos-14-xlarge
:warning: [webkit-library] › library/tracing.spec.ts:432:14 › should produce screencast frames scale @webkit-macos-14-xlarge
:warning: [webkit-page] › page/page-request-continue.spec.ts:185:5 › post data › should amend post data @webkit-macos-14-xlarge
:warning: [webkit-page] › page/page-request-continue.spec.ts:228:5 › post data › should amend utf8 post data @webkit-macos-15-xlarge
:warning: [webkit-library] › library/browsercontext-viewport-mobile.spec.ts:97:5 › mobile viewport › should fire orientationchange event @webkit-ubuntu-20.04
:warning: [webkit-library] › library/screenshot.spec.ts:219:14 › element screenshot › element screenshot should work with device scale factor @webkit-ubuntu-20.04
:warning: [webkit-library] › library/video.spec.ts:189:5 › screencast › should capture static page @webkit-ubuntu-20.04

241065 passed, 9534 skipped :heavy_check_mark::heavy_check_mark::heavy_check_mark:

Merge workflow run.