search

servo / servo

Servo, the embeddable, independent, memory-safe, modular, parallel web rendering engine
https://servo.org
Mozilla Public License 2.0
28.35k stars 3.03k forks source link

Intermittent failure analysis (2023-01-10) #29223

Closed delan closed 1 year ago

delan commented 1 year ago 
     40 /webvtt/api/VTTRegion/non-visible-cue-with-region.html
     40 /_webgl/conformance/textures/misc/texture-npot-video.html
     40 /_webgl/conformance/textures/misc/copy-tex-image-and-sub-image-2d.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-rgb-rgb-unsigned_short_5_6_5.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-rgb-rgb-unsigned_byte.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-rgba-rgba-unsigned_short_5_5_5_1.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-rgba-rgba-unsigned_short_4_4_4_4.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-rgba-rgba-unsigned_byte.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-luminance-luminance-unsigned_byte.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-luminance_alpha-luminance_alpha-unsigned_byte.html
     40 /_webgl/conformance/textures/image_bitmap_from_video/tex-2d-alpha-alpha-unsigned_byte.html
     40 /_webgl/conformance2/transform_feedback/too-small-buffers.html
     40 /webaudio/the-audio-api/the-stereopanner-interface/stereopannernode-basic.html
     40 /webaudio/the-audio-api/the-periodicwave-interface/periodicWave.html
     40 /webaudio/the-audio-api/the-pannernode-interface/pannernode-basic.window.html
     40 /webaudio/the-audio-api/the-mediastreamaudiosourcenode-interface/mediastreamaudiosourcenode-routing.html
     40 /webaudio/the-audio-api/the-mediastreamaudiosourcenode-interface/mediastreamaudiosourcenode-ctor.html
     40 /webaudio/the-audio-api/the-mediastreamaudiodestinationnode-interface/ctor-mediastreamaudiodestination.html
     40 /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/no-cors.https.html
     40 /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/mediaElementAudioSourceToScriptProcessorTest.html
     40 /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/cors-check.https.html
     40 /webaudio/the-audio-api/the-iirfilternode-interface/test-iirfilternode.html
     40 /webaudio/the-audio-api/the-gainnode-interface/gain-basic.html
     40 /webaudio/the-audio-api/the-destinationnode-interface/destination.html
     40 /webaudio/the-audio-api/the-convolvernode-interface/realtime-conv.html
     40 /webaudio/the-audio-api/the-convolvernode-interface/convolver-setBuffer-null.html
     40 /webaudio/the-audio-api/the-convolvernode-interface/convolver-setBuffer-already-has-value.html
     40 /webaudio/the-audio-api/the-convolvernode-interface/active-processing.https.html
     40 /webaudio/the-audio-api/the-constantsourcenode-interface/test-constantsourcenode.html
     40 /webaudio/the-audio-api/the-constantsourcenode-interface/constant-source-basic.html
     40 /webaudio/the-audio-api/the-channelmergernode-interface/active-processing.https.html
     40 /webaudio/the-audio-api/the-biquadfilternode-interface/biquad-getFrequencyResponse.html
     40 /webaudio/the-audio-api/the-biquadfilternode-interface/biquadfilternode-basic.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/suspended-context-messageport.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/process-parameters.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/processor-construction-port.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/process-getter.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/baseaudiocontext-audioworklet.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-throw-onmessage.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-suspend.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-registerprocessor-dynamic.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-registerprocessor-called-on-globalthis.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-promises.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-process-zero-outputs.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-process-frozen-array.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletprocessor-options.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-postmessage-sharedarraybuffer.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletnode-output-channel-count.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworkletnode-construction.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-messageport.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-audioparam-iterable.https.html
     40 /webaudio/the-audio-api/the-audioworklet-interface/audioworklet-addmodule-resolution.https.html
     40 /webaudio/the-audio-api/the-audioparam-interface/audioparam-nominal-range.html
     40 /webaudio/the-audio-api/the-audioparam-interface/audioparam-method-chaining.html
     40 /webaudio/the-audio-api/the-audionode-interface/different-contexts.html
     40 /webaudio/the-audio-api/the-audionode-interface/audionode-iframe.window.html
     40 /webaudio/the-audio-api/the-audionode-interface/audionode.html
     40 /webaudio/the-audio-api/the-audionode-interface/audionode-disconnect-audioparam.html
     40 /webaudio/the-audio-api/the-audionode-interface/audionode-connect-method-chaining.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/suspend-with-navigation.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/suspend-after-construct.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/promise-methods-after-discard.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/processing-after-resume.https.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/audiocontext-sinkid-state-change.https.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/audiocontext-sinkid-setsinkid.https.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/audiocontext-getoutputtimestamp.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/audiocontext-getoutputtimestamp-cross-realm.html
     40 /webaudio/the-audio-api/the-audiocontext-interface/audiocontext-detached-execution-context.html
     40 /webaudio/the-audio-api/the-audiobuffersourcenode-interface/audiobuffersource-multi-channels.html
     40 /webaudio/the-audio-api/the-audiobuffersourcenode-interface/audiobuffersource-channels.html
     40 /webaudio/the-audio-api/the-audiobuffer-interface/audiobuffer.html
     40 /webaudio/the-audio-api/the-audiobuffer-interface/audiobuffer-getChannelData.html
     40 /webaudio/the-audio-api/the-audiobuffer-interface/audiobuffer-copy-channel.html
     40 /webaudio/the-audio-api/the-analysernode-interface/test-analyser-scale.html
     40 /webaudio/the-audio-api/the-analysernode-interface/test-analyser-output.html
     40 /webaudio/the-audio-api/the-analysernode-interface/test-analysernode.html
     40 /webaudio/the-audio-api/the-analysernode-interface/test-analyser-minimum.html
     40 /webaudio/the-audio-api/the-analysernode-interface/realtimeanalyser-basic.html
     40 /webaudio/idlharness.https.window.html
     40 /_mozilla/gfx-rs-gecko/opacity-background-1.html
     40 /_mozilla/css/text_decoration_underline_subpx_a.html
     40 /_mozilla/css/input_selection_a.html
     40 /_mozilla/css/inline_block_baseline_a.html
     40 /_mozilla/css/font_face_attribute.html
     40 /_mozilla/css/font_advance.html
     40 /html/semantics/embedded-content/media-elements/video_loop_base.html
     40 /html/semantics/embedded-content/media-elements/track/track-element/track-remove-by-setting-innerHTML.html
     40 /html/semantics/embedded-content/media-elements/track/track-element/track-mode-not-changed-by-new-track.html
     40 /html/semantics/embedded-content/media-elements/track/track-element/track-mode-disabled.html
     40 /html/semantics/embedded-content/media-elements/track/track-element/track-cue-mutable-fragment.html
     40 /html/semantics/embedded-content/media-elements/track/track-element/no-cuechange-before-play.html
     40 /html/semantics/embedded-content/media-elements/mime-types/canPlayType.html
     40 /html/semantics/embedded-content/media-elements/event_timeupdate.html
     40 /fetch/metadata/audio-worklet.https.html
     40 /css/css-values/line-break-ch-unit.html
     40 /css/css-transforms/transform-percent-008.html
     40 /css/css-transforms/transform-input-017.html
     40 /css/css-text/word-break/word-break-normal-hi-000.html
     40 /css/css-text/word-break/word-break-normal-bo-000.html
     40 /css/css-text/word-break/word-break-keep-all-063.html
     40 /css/css-text/word-break/word-break-break-all-inline-005.html
     40 /css/css-text/word-break/word-break-break-all-inline-003.html
     40 /css/css-text/word-break/word-break-break-all-inline-002.html
     40 /css/css-text/word-break/word-break-break-all-inline-001.html
     40 /css/css-text/word-break/word-break-break-all-062.html
     40 /css/css-text/word-break/word-break-break-all-032.html
     40 /css/css-text/word-break/word-break-break-all-008.html
     40 /css/css-text/white-space/white-space-pre-wrap-trailing-spaces-021.html
     40 /css/css-text/white-space/white-space-pre-wrap-trailing-spaces-001.html
     40 /css/css-text/white-space/white-space-normal-011.html
     40 /css/css-text/white-space/white-space-collapse-002.html
     40 /css/css-text/white-space/trailing-space-align-start.tentative.html
     40 /css/css-text/white-space/seg-break-transformation-015.tentative.html
     40 /css/css-text/white-space/seg-break-transformation-014.tentative.html
     40 /css/css-text/white-space/pre-wrap-018.html
     40 /css/css-text/text-encoding/shaping-no-join-003.html
     40 /css/css-text/text-encoding/shaping-no-join-001.html
     40 /css/css-text/line-break/line-break-loose-hyphens-002.html
     40 /css/css-text/hyphens/hyphenate-character-001.html
     40 /css/css-text/hanging-punctuation/hanging-punctuation-block-bound-001.html
     40 /css/css-text-decor/text-decoration-propagation-display-contents.html
     40 /css/css-images/gradient-move-stops.html
     36 /websockets/unload-a-document/005.html?wpt_flags=h2
     36 /websockets/stream/tentative/constructor.any.sharedworker.html?wpt_flags=h2
     36 /websockets/Send-binary-arraybuffer.any.html?wpt_flags=h2
     36 /websockets/Create-valid-url-protocol-string.any.html?wpt_flags=h2
     36 /websockets/constructor/019.html?wpt_flags=h2
     36 /websockets/basic-auth.any.worker.html?wpt_flags=h2
     35 /websockets/stream/tentative/constructor.any.serviceworker.html?wpt_flags=h2
     35 /websockets/stream/tentative/abort.any.worker.html?wpt_flags=h2
     35 /websockets/Send-data.any.html?wpt_flags=h2
     35 /websockets/Send-binary-arraybufferview-uint16-offset-length.any.html?wpt_flags=h2
     35 /websockets/interfaces/WebSocket/send/009.html?wpt_flags=h2
     35 /websockets/Create-valid-url-protocol-setCorrectly.any.html?wpt_flags=h2
     35 /websockets/constructor/009.html?wpt_flags=h2
     35 /websockets/constructor/006.html?wpt_flags=h2
     35 /websockets/closing-handshake/004.html?wpt_flags=h2
     35 /websockets/binary/004.html?wpt_flags=h2
     34 /websockets/stream/tentative/constructor.any.html?wpt_flags=h2
     34 /websockets/Send-binary-arraybufferview-int32.any.worker.html?wpt_flags=h2
     34 /websockets/Send-binary-arraybufferview-float32.any.worker.html?wpt_flags=h2
     34 /websockets/Send-65K-data.any.html?wpt_flags=h2
     34 /websockets/Send-0byte-data.any.worker.html?wpt_flags=h2
     34 /websockets/interfaces/WebSocket/bufferedAmount/bufferedAmount-getting.html?wpt_flags=h2
     34 /websockets/Create-wrong-scheme.any.html?wpt_flags=h2
     34 /websockets/Create-valid-url-protocol-empty.any.html?wpt_flags=h2
     34 /websockets/Create-valid-url-array-protocols.any.html?wpt_flags=h2
     34 /websockets/Create-protocol-with-space.any.worker.html?wpt_flags=h2
     34 /websockets/constructor/004.html?wpt_flags=h2
     34 /websockets/constructor/001.html?wpt_flags=h2
     33 /websockets/stream/tentative/close.any.sharedworker.html?wpt_flags=h2
     33 /websockets/stream/tentative/close.any.serviceworker.html?wpt_flags=h2
     33 /websockets/stream/tentative/backpressure-receive.any.serviceworker.html?wpt_flags=h2
     33 /websockets/stream/tentative/backpressure-receive.any.html?wpt_flags=h2
     33 /websockets/Send-unpaired-surrogates.any.html?wpt_flags=h2
     33 /websockets/Send-binary-blob.any.worker.html?wpt_flags=h2
     33 /websockets/keeping-connection-open/001.html?wpt_flags=h2
     33 /websockets/interfaces/WebSocket/send/011.html?wpt_flags=h2
     33 /websockets/interfaces/WebSocket/events/016.html?wpt_flags=h2
     33 /websockets/interfaces/WebSocket/events/015.html?wpt_flags=h2
     33 /websockets/eventhandlers.any.worker.html?wpt_flags=h2
     33 /websockets/eventhandlers.any.html?wpt_flags=h2
     33 /websockets/Create-valid-url-protocol.any.worker.html?wpt_flags=h2
     33 /websockets/Create-valid-url.any.html?wpt_flags=h2
     33 /websockets/constructor/022.html?wpt_flags=h2
     33 /websockets/constructor/021.html?wpt_flags=h2
     33 /websockets/Close-reason-unpaired-surrogates.any.html?wpt_flags=h2
     33 /websockets/Close-readyState-Closed.any.worker.html?wpt_flags=h2
     33 /websockets/Close-4999-reason.any.html?wpt_flags=h2
     33 /websockets/Close-1005-verify-code.any.html?wpt_flags=h2
     33 /websockets/basic-auth.any.html?wpt_flags=h2
     32 /xhr/status.h2.window.html
     32 /websockets/stream/tentative/close.any.worker.html?wpt_flags=h2
     32 /websockets/stream/tentative/backpressure-send.any.serviceworker.html?wpt_flags=h2
     32 /websockets/stream/tentative/backpressure-send.any.html?wpt_flags=h2
     32 /websockets/stream/tentative/backpressure-receive.any.worker.html?wpt_flags=h2
     32 /websockets/stream/tentative/backpressure-receive.any.sharedworker.html?wpt_flags=h2
     32 /websockets/stream/tentative/abort.any.sharedworker.html?wpt_flags=h2
     32 /websockets/Send-unicode-data.any.html?wpt_flags=h2
     32 /websockets/Send-paired-surrogates.any.worker.html?wpt_flags=h2
     32 /websockets/Send-null.any.worker.html?wpt_flags=h2
     32 /websockets/Send-null.any.html?wpt_flags=h2
     32 /websockets/Send-data.any.worker.html?wpt_flags=h2
     32 /websockets/Send-binary-arraybufferview-uint8-offset.any.worker.html?wpt_flags=h2
     32 /websockets/Send-binary-arraybufferview-int16-offset.any.worker.html?wpt_flags=h2
     32 /websockets/Send-binary-arraybufferview-float64.any.html?wpt_flags=h2
     32 /websockets/Send-binary-arraybufferview-float32.any.html?wpt_flags=h2
     32 /websockets/interfaces/WebSocket/send/012.html?wpt_flags=h2
     32 /websockets/interfaces/WebSocket/events/001.html?wpt_flags=h2
     32 /websockets/interfaces/WebSocket/bufferedAmount/bufferedAmount-unicode.html?wpt_flags=h2
     32 /websockets/interfaces/WebSocket/bufferedAmount/bufferedAmount-large.html?wpt_flags=h2
     32 /websockets/interfaces/WebSocket/bufferedAmount/bufferedAmount-blob.html?wpt_flags=h2
     32 /websockets/Create-valid-url-protocol-setCorrectly.any.worker.html?wpt_flags=h2
     32 /websockets/Create-nonAscii-protocol-string.any.worker.html?wpt_flags=h2
     32 /websockets/Create-extensions-empty.any.worker.html?wpt_flags=h2
     32 /websockets/cookies/002.html?wpt_flags=h2
     32 /websockets/constructor/020.html?wpt_flags=h2
     32 /websockets/constructor/018.html?wpt_flags=h2
     32 /websockets/constructor/011.html?wpt_flags=h2
     32 /websockets/constructor/005.html?wpt_flags=h2
     32 /websockets/closing-handshake/003.html?wpt_flags=h2
     32 /websockets/Close-undefined.any.worker.html?wpt_flags=h2
     32 /websockets/Close-undefined.any.html?wpt_flags=h2
     32 /websockets/Close-4999-reason.any.worker.html?wpt_flags=h2
     32 /websockets/Close-1005-verify-code.any.worker.html?wpt_flags=h2
     31 /websockets/unload-a-document/002.html?wpt_flags=h2
     31 /websockets/stream/tentative/backpressure-send.any.sharedworker.html?wpt_flags=h2
     31 /websockets/stream/tentative/abort.any.serviceworker.html?wpt_flags=h2
     31 /websockets/Send-data.worker.html?wpt_flags=h2
     31 /websockets/Send-binary-arraybufferview-uint16-offset-length.any.worker.html?wpt_flags=h2
     31 /websockets/Send-binary-arraybufferview-int8.any.worker.html?wpt_flags=h2
     31 /websockets/Send-binary-arraybufferview-int32.any.html?wpt_flags=h2
     31 /websockets/Send-binary-arraybuffer.any.worker.html?wpt_flags=h2
     31 /websockets/Send-before-open.any.worker.html?wpt_flags=h2
     31 /websockets/Send-before-open.any.html?wpt_flags=h2
     31 /websockets/remove-own-iframe-during-onerror.window.html?wpt_flags=h2
     31 /websockets/opening-handshake/001.html?wpt_flags=h2
     31 /websockets/interfaces/WebSocket/bufferedAmount/bufferedAmount-arraybuffer.html?wpt_flags=h2
     31 /websockets/Create-wrong-scheme.any.worker.html?wpt_flags=h2
     31 /websockets/Create-valid-url-binaryType-blob.any.worker.html?wpt_flags=h2
     31 /websockets/Create-url-with-space.any.worker.html?wpt_flags=h2
     31 /websockets/Create-protocols-repeated-case-insensitive.any.html?wpt_flags=h2
     31 /websockets/Create-protocols-repeated.any.worker.html?wpt_flags=h2
     31 /websockets/Create-non-absolute-url.any.html?wpt_flags=h2
     31 /websockets/Create-blocked-port.any.worker.html?wpt_flags=h2
     31 /websockets/Create-asciiSep-protocol-string.any.worker.html?wpt_flags=h2
     31 /websockets/Close-reason-unpaired-surrogates.any.worker.html?wpt_flags=h2
     31 /websockets/Close-Reason-124Bytes.any.html?wpt_flags=h2
     31 /websockets/Close-delayed.any.html?wpt_flags=h2
     31 /websockets/Close-3000-verify-code.any.html?wpt_flags=h2
     31 /websockets/bufferedAmount-unchanged-by-sync-xhr.any.sharedworker.html?wpt_flags=h2
     31 /websockets/binaryType-wrong-value.any.worker.html?wpt_flags=h2
     31 /websockets/binary/005.html?wpt_flags=h2
     31 /websockets/binary/001.html?wpt_flags=h2
     31 /websockets/basic-auth.any.sharedworker.html?wpt_flags=h2
     31 /websockets/basic-auth.any.serviceworker.html?wpt_flags=h2
     30 /websockets/stream/tentative/abort.any.html?wpt_flags=h2
     30 /websockets/Send-binary-arraybufferview-uint8-offset-length.any.worker.html?wpt_flags=h2
     30 /websockets/Send-binary-arraybufferview-int16-offset.any.html?wpt_flags=h2
     30 /websockets/Send-binary-arraybufferview-float64.any.worker.html?wpt_flags=h2
     30 /websockets/Send-binary-65K-arraybuffer.any.worker.html?wpt_flags=h2
     30 /websockets/interfaces/WebSocket/send/006.html?wpt_flags=h2
     30 /websockets/interfaces/WebSocket/events/018.html?wpt_flags=h2
     30 /websockets/extended-payload-length.html?wpt_flags=h2
     30 /websockets/Create-valid-url-binaryType-blob.any.html?wpt_flags=h2
     30 /websockets/Create-valid-url.any.worker.html?wpt_flags=h2
     30 /websockets/Create-protocols-repeated-case-insensitive.any.worker.html?wpt_flags=h2
     30 /websockets/Create-protocols-repeated.any.html?wpt_flags=h2
     30 /websockets/cookies/006.html?wpt_flags=h2
     30 /websockets/constructor.any.worker.html?wpt_flags=h2
     30 /websockets/constructor/017.html?wpt_flags=h2
     30 /websockets/Close-server-initiated-close.any.worker.html?wpt_flags=h2
     30 /websockets/Close-server-initiated-close.any.html?wpt_flags=h2
     30 /websockets/Close-Reason-124Bytes.any.worker.html?wpt_flags=h2
     30 /websockets/Close-onlyReason.any.html?wpt_flags=h2
     30 /websockets/close-invalid.any.html?wpt_flags=h2
     30 /websockets/Close-1000-reason.any.worker.html?wpt_flags=h2
     30 /websockets/Close-1000.any.html?wpt_flags=h2
     30 /websockets/bufferedAmount-unchanged-by-sync-xhr.any.html?wpt_flags=h2
     30 /websockets/binaryType-wrong-value.any.html?wpt_flags=h2
     29 /websockets/unload-a-document/001.html?wpt_flags=h2
     29 /websockets/stream/tentative/backpressure-send.any.worker.html?wpt_flags=h2
     29 /websockets/Send-unpaired-surrogates.any.worker.html?wpt_flags=h2
     29 /websockets/Send-binary-arraybufferview-int8.any.html?wpt_flags=h2
     29 /websockets/Send-0byte-data.any.html?wpt_flags=h2
     29 /websockets/opening-handshake/002.html?wpt_flags=h2
     29 /websockets/interfaces/WebSocket/events/017.html?wpt_flags=h2
     29 /websockets/interfaces/WebSocket/events/007.html?wpt_flags=h2
     29 /websockets/interfaces/WebSocket/events/002.html?wpt_flags=h2
     29 /websockets/Create-valid-url-protocol.any.html?wpt_flags=h2
     29 /websockets/Create-valid-url-array-protocols.any.worker.html?wpt_flags=h2
     29 /websockets/Create-nonAscii-protocol-string.any.html?wpt_flags=h2
     29 /websockets/Create-invalid-urls.any.html?wpt_flags=h2
     29 /websockets/constructor.any.html?wpt_flags=h2
     29 /websockets/constructor/013.html?wpt_flags=h2
     29 /websockets/constructor/010.html?wpt_flags=h2
     29 /websockets/Close-readyState-Closing.any.html?wpt_flags=h2
     29 /websockets/Close-readyState-Closed.any.html?wpt_flags=h2
     29 /websockets/close-invalid.any.worker.html?wpt_flags=h2
     29 /websockets/Close-3000-verify-code.any.worker.html?wpt_flags=h2
     29 /websockets/Close-3000-reason.any.worker.html?wpt_flags=h2
     29 /websockets/Close-1000-verify-code.any.worker.html?wpt_flags=h2
     29 /websockets/binary/002.html?wpt_flags=h2
     28 /websockets/stream/tentative/constructor.any.worker.html?wpt_flags=h2
     28 /websockets/Send-unicode-data.any.worker.html?wpt_flags=h2
     28 /websockets/Send-binary-blob.any.html?wpt_flags=h2
     28 /websockets/Send-binary-arraybufferview-uint8-offset.any.html?wpt_flags=h2
     28 /websockets/Send-binary-arraybufferview-uint32-offset.any.worker.html?wpt_flags=h2
     28 /websockets/interfaces/WebSocket/send/007.html?wpt_flags=h2
     28 /websockets/Create-url-with-space.any.html?wpt_flags=h2
     28 /websockets/Create-protocol-with-space.any.html?wpt_flags=h2
     28 /websockets/Create-non-absolute-url.any.worker.html?wpt_flags=h2
     28 /websockets/Create-extensions-empty.any.html?wpt_flags=h2
     28 /websockets/Create-asciiSep-protocol-string.any.html?wpt_flags=h2
     28 /websockets/cookies/003.html?wpt_flags=h2
     28 /websockets/cookies/001.html?wpt_flags=h2
     28 /websockets/Close-delayed.any.worker.html?wpt_flags=h2
     28 /websockets/Close-1005.any.worker.html?wpt_flags=h2
     28 /websockets/Close-1005.any.html?wpt_flags=h2
     28 /websockets/Close-1000-verify-code.any.html?wpt_flags=h2
     28 /websockets/Close-1000.any.worker.html?wpt_flags=h2
     27 /websockets/Send-paired-surrogates.any.html?wpt_flags=h2
     27 /websockets/Send-65K-data.any.worker.html?wpt_flags=h2
     27 /websockets/Create-valid-url-protocol-empty.any.worker.html?wpt_flags=h2
     27 /websockets/Create-blocked-port.any.html?wpt_flags=h2
     27 /websockets/cookies/007.html?wpt_flags=h2
     27 /websockets/closing-handshake/002.html?wpt_flags=h2
     27 /websockets/Close-readyState-Closing.any.worker.html?wpt_flags=h2
     27 /websockets/Close-onlyReason.any.worker.html?wpt_flags=h2
     27 /websockets/Close-3000-reason.any.html?wpt_flags=h2
     27 /websockets/Close-2999-reason.any.worker.html?wpt_flags=h2
     27 /html/canvas/element/manual/drawing-text-to-the-canvas/canvas.2d.disconnected.html
     26 /websockets/Send-binary-arraybufferview-uint32-offset.any.html?wpt_flags=h2
     26 /websockets/interfaces/CloseEvent/clean-close.html?wpt_flags=h2
     26 /websockets/Create-valid-url-protocol-string.any.worker.html?wpt_flags=h2
     26 /websockets/Create-invalid-urls.any.worker.html?wpt_flags=h2
     26 /websockets/constructor/012.html?wpt_flags=h2
     26 /websockets/Close-2999-reason.any.html?wpt_flags=h2
     26 /websockets/Close-1000-reason.any.html?wpt_flags=h2
     25 /websockets/Send-binary-65K-arraybuffer.any.html?wpt_flags=h2
     24 /websockets/Send-binary-arraybufferview-uint8-offset-length.any.html?wpt_flags=h2
     24 /websockets/bufferedAmount-unchanged-by-sync-xhr.any.worker.html?wpt_flags=h2
     22 /websockets/constructor/007.html?wpt_flags=h2
     15 /html/browsers/browsing-the-web/navigating-across-documents/about-srcdoc-navigation-blocked.window.html
      5 /css/css-images/object-view-box-writing-mode-video.html
      1 /_mozilla/css/text_overflow_ellipsis.html
      1 /css/selectors/old-tests/css3-modsel-7b.xml
      1 /css/selectors/nth-last-child-specificity-4.html
      1 /css/mediaqueries/prefers-color-scheme-svg-image-normal.html
      1 /css/css-text/text-transform/math/text-transform-math-stretched-001.tentative.html
      1 /css/css-text/text-align/text-align-justifyall-002.html
      1 /css/css-text-decor/text-decoration-subelements-003.html
      1 /css/css-text-decor/text-decoration-skip-ink-sidewayslr-001.html
      1 /css/css-text/boundary-shaping/boundary-shaping-004.html
      1 /css/css-fonts/math-script-level-and-math-style/math-script-level-auto-and-math-style-001.tentative.html
      1 /css/css-flexbox/flexbox_flex-N-1-N-shrink.html
      1 /css/css-conditional/css-supports-032.xht
      1 /css/css-backgrounds/border-image-repeat-space-7.html
      1 /css/CSS2/visudet/line-height-203.html
      1 /css/CSS2/selectors/first-letter-punctuation-105.xht
      1 /css/CSS2/positioning/position-relative-010.xht
      1 /css/CSS2/normal-flow/min-height-105.xht
      1 /css/CSS2/margin-padding-clear/padding-left-084.xht
      1 /css/CSS2/margin-padding-clear/padding-bottom-026.xht
      1 /css/CSS2/generated-content/quotes-applies-to-012.xht
      1 /css/CSS2/generated-content/content-050.xht
      1 /css/CSS2/generated-content/after-content-display-008.xht
      1 /css/CSS2/fonts/font-size-078.xht
      1 /css/CSS2/css1/c5514-brdr-lw-001.xht
      1 /css/CSS2/borders/border-top-color-130.xht
      1 /css/CSS2/borders/border-top-color-029.xht
      1 /css/CSS2/borders/border-bottom-width-applies-to-003.xht

Collected logs for 40 runs of the WPT suite with

$ for i in {0..39}; do ./mach test-wpt --release --processes $(nproc) --timeout-multiplier 2 --log-raw raw.$i.log --log-servojson servojson.$i.log; sleep 1; i=$((i+1)); done

Filtered intermittents in json format (json-intermittents.tar.gz) with #29222 and

$ for i in {0..39}; do ./mach filter-intermittents servojson.$i.log --json --log-intermittents intermittents.$i.log --log-filteredsummary filtered.$i.log --tracker-api default --reporter-api default & done

Aggregate failure counts (aggregate.tar.gz) computed with

$ for j in filtered intermittents; do : > $j.tests.txt; for i in {0..39}; do < $j.$i.log jq -r 'map(.test) | .[]' >> $j.tests.txt; done; < $j.tests.txt sort | uniq -c | sort -nr > $j.counts.txt; done
delan commented 1 year ago

Intuitively I would say let’s update expectations for the 40s and create intermittents for the >1s, but I wonder:

  1. are any of the 40/40 failures just my local build?
  2. should we update expectations or similar for any of the 40/40 failures?
  3. why did so many websocket tests fail 55–90% of the time?

The non-40s that otherwise really stand out to me are:

delan commented 1 year ago

5 /css/css-images/object-view-box-writing-mode-video.html

$ jq 'map(select(.test | startswith("/css/css-images/object-view-box-writing-mode-video.html"))) | .[].output' filtered.*.log
"  ▶ FAIL [expected PASS] b'/css/css-images/object-view-box-writing-mode-video.html'\n  │   → /css/css-images/object-view-box-writing-mode-video.html ['8234e070bef85536b8ff2b855e415c3eed4f7451']\n  │   → /css/css-images/object-view-box-writing-mode-video-ref.html ['3efde5272018068c43777467ef669326ae60c92b']\n  └   → Screenshot is solid color 0xFFFFFF for /css/css-images/object-view-box-writing-mode-video.html\n\n"
"  ▶ FAIL [expected PASS] b'/css/css-images/object-view-box-writing-mode-video.html'\n  │   → /css/css-images/object-view-box-writing-mode-video.html ['a0e584dbdd5df997264aeae983d5cb33680929ae']\n  │   → /css/css-images/object-view-box-writing-mode-video-ref.html ['8234e070bef85536b8ff2b855e415c3eed4f7451']\n  └   → Screenshot is solid color 0xFFFFFF for /css/css-images/object-view-box-writing-mode-video-ref.html\n\n"
"  ▶ FAIL [expected PASS] b'/css/css-images/object-view-box-writing-mode-video.html'\n  │   → /css/css-images/object-view-box-writing-mode-video.html ['a0e584dbdd5df997264aeae983d5cb33680929ae']\n  │   → /css/css-images/object-view-box-writing-mode-video-ref.html ['8234e070bef85536b8ff2b855e415c3eed4f7451']\n  └   → Screenshot is solid color 0xFFFFFF for /css/css-images/object-view-box-writing-mode-video-ref.html\n\n"
"  ▶ FAIL [expected PASS] b'/css/css-images/object-view-box-writing-mode-video.html'\n  │   → /css/css-images/object-view-box-writing-mode-video.html ['8234e070bef85536b8ff2b855e415c3eed4f7451']\n  │   → /css/css-images/object-view-box-writing-mode-video-ref.html ['3efde5272018068c43777467ef669326ae60c92b']\n  └   → Screenshot is solid color 0xFFFFFF for /css/css-images/object-view-box-writing-mode-video.html\n\n"
"  ▶ FAIL [expected PASS] b'/css/css-images/object-view-box-writing-mode-video.html'\n  │   → /css/css-images/object-view-box-writing-mode-video.html ['a0e584dbdd5df997264aeae983d5cb33680929ae']\n  │   → /css/css-images/object-view-box-writing-mode-video-ref.html ['8234e070bef85536b8ff2b855e415c3eed4f7451']\n  └   → Screenshot is solid color 0xFFFFFF for /css/css-images/object-view-box-writing-mode-video-ref.html\n\n"

white reftest screenshot!

delan commented 1 year ago

27 /html/canvas/element/manual/drawing-text-to-the-canvas/canvas.2d.disconnected.html

$ jq -r 'map(select(.test | startswith("/html/canvas/element/manual/drawing-text-to-the-canvas/canvas.2d.disconnected.html"))) | .[].output' filtered.*.log | grep . | sort | uniq -c
     27   ▶ TIMEOUT [expected FAIL] b'/html/canvas/element/manual/drawing-text-to-the-canvas/canvas.2d.disconnected.html'

all timeouts! but this build says FAIL [expected TIMEOUT] :thinking:

delan commented 1 year ago

I just realised I had layout-2020 enabled in my .servobuild :disappointed: