WordPress / gutenberg

The Block Editor project for WordPress and beyond. Plugin is available from the official repository.
https://wordpress.org/gutenberg/
Other
10k stars 4.02k forks source link

[Flaky Test] should open a preview window for a new post #35387

Open github-actions[bot] opened 2 years ago

github-actions[bot] commented 2 years ago

Flaky test detected. This is an auto-generated issue by GitHub Actions. Please do NOT edit this manually.

Test title

should open a preview window for a new post

Test path

/test/e2e/specs/editor/various/preview.spec.js

Errors

Test passed after 1 failed attempt on fix/save-focus-loss.


Test passed after 2 failed attempts on trunk.


Test passed after 1 failed attempt on mobile/issue/3055-show-disabled-block-reason.


Test passed after 1 failed attempt on try/link-control-split-url-text.


Test passed after 2 failed attempts on add/detailed-loading-performance-times.


Test passed after 2 failed attempts on fix/inlined-relative-urls.


Test passed after 2 failed attempts on update/theme-block-placeholder-content.


Test passed after 2 failed attempts on add/template-details-for-template-part.


Test passed after 2 failed attempts on update/card-global-styles-root.


Test passed after 2 failed attempts on fix-helphub-link-i18n.


Test passed after 2 failed attempts on fix/block-inserter-gap.


Test passed after 1 failed attempt on bug/help-section-overflow.


Test passed after 2 failed attempts on update/components-navigator-sticky.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on remove/use-jump-step.


Test passed after 2 failed attempts on bug/android-bottom-sheet-overlay.


Test passed after 2 failed attempts on trunk.


Test passed after 2 failed attempts on trunk.


Test passed after 2 failed attempts on update/inspector-controls-design-tools-order.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/toggle-group-control-visual-state-when-value-not-exists-in-options.


Test passed after 1 failed attempt on add/edit-site-list.


Test passed after 1 failed attempt on try/alternate-fixed-appender.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on try/partial-multi-selection.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on update/re-architect-templates-addition.


Test passed after 1 failed attempt on add/slider-component.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on update/add-canRead-to-use-resource-permissions.


Test passed after 1 failed attempt on try/tools-panel-in-global-styles.


Test passed after 1 failed attempt on form-fields.


Test passed after 1 failed attempt on migrate/gallery-caption-tests-playwright.


Test passed after 1 failed attempt on tests/record-cpus-data.


Test passed after 1 failed attempt on fix/color-palette-pattern.


Test passed after 1 failed attempt on fix/text-control-storybook-help-label-type.


Test passed after 1 failed attempt on refactor/url-popover-placement-position.


Test passed after 1 failed attempt on add-test-for-post-title-block-render.


Test passed after 1 failed attempt on upgrade/react-18-pure-with-react-native-upgrade.


Test passed after 1 failed attempt on fix/undo-after-autocorrect.


Test passed after 1 failed attempt on refactor/lodash-filter.


Test passed after 1 failed attempt on perf/refactor-tree.


Test passed after 1 failed attempt on update/hide-context-block-toolbar.


Test passed after 1 failed attempt on add/block-style-editing.


Test passed after 1 failed attempt on use/offsite-menu-component-on-the-navigation-inspector.


Test passed after 1 failed attempt on refactor/lodash-find-core-data.


Test passed after 1 failed attempt on ts-responsive-wrapper.


Test passed after 1 failed attempt on fix/42689.


Test passed after 1 failed attempt on trunk.


Test passed after 2 failed attempts on add/typography-columns-support.


Test passed after 1 failed attempt on try/page-list-submenu.


Test passed after 1 failed attempt on add/query-loop-terms-dynamic-suggestions-fetching.


Test passed after 1 failed attempt on add/query-loop-terms-dynamic-suggestions-fetching.


Test passed after 1 failed attempt on fix/performance-tests.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on try/improve-block-context-cache.


Test passed after 1 failed attempt on update/post-featured-image-wrapper-height.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/arrow-key-resizing.


Test passed after 1 failed attempt on add/get-set-content-inside-balanced-tags.


Test passed after 1 failed attempt on update/custom-css-move-to-menu.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on add/tag-selection-dropdown.


Test passed after 1 failed attempt on refactor/Notice-typescript.


Test passed after 2 failed attempts on optimize/downloadable-blocks-panel.


Test passed after 2 failed attempts on fix/colorpalette-contrast-check.


Test passed after 1 failed attempt on refactor/tools-panel-ts.


Test passed after 1 failed attempt on tests/store-perf-test-results.


Test passed after 1 failed attempt on fix/core-data-hooks-eslint.


Test passed after 1 failed attempt on add/template-modal.


Test passed after 1 failed attempt on rename-experiments-to-private-apis.


Test passed after 1 failed attempt on remove/lodash-wordpress-data.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on tests/store-perf-test-results.


Test passed after 1 failed attempt on tests/store-perf-test-results.


Test passed after 1 failed attempt on try/link-preview.


Test passed after 1 failed attempt on refactor/remove-name-element-props-from-typography-panel.


Test passed after 1 failed attempt on try/list-view-scroll-off-screen-selected-blocks-into-view.


Test passed after 1 failed attempt on fix/render_block_core_page_list.


Test passed after 1 failed attempt on wp/6.2.


Test passed after 1 failed attempt on fix/customized-template-info-accessibility.


Test passed after 1 failed attempt on fix-i18n/date-format-picker.


Test passed after 1 failed attempt on fix-i18n/block-parent-selector.


Test passed after 1 failed attempt on migrate/playwright-multi-block-selection.


Test passed after 1 failed attempt on migrate/playwright-multi-block-selection.


Test passed after 1 failed attempt on rnmobile/add-reassure.


Test passed after 1 failed attempt on try/test-pr-46983.


Test passed after 1 failed attempt on feat/storybook-e2e-tests-custom-controls.


Test passed after 1 failed attempt on revert/link-control-changes.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on add/site-logo-border.


Test passed after 1 failed attempt on add/details-summary-block.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/layout-class-attribution.


Test passed after 1 failed attempt on wp/6.2.


Test passed after 1 failed attempt on refactor/Autocomplete-typescript.


Test passed after 1 failed attempt on refactor/guide-typescript.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on remove/use-anchor-value-dependency.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/browse-mode-desc-margings.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on try/global-styles-style-engine.


Test passed after 1 failed attempt on add/styles-section-to-the-browse-mode-sidebar.


Test passed after 1 failed attempt on fix/global-styles-getPresetsClasses-crashes-if-there-is-no-selector-passed.


Test passed after 1 failed attempt on try/grid-layout.


Test passed after 1 failed attempt on update/default-media-text-align-to-none.


Test passed after 1 failed attempt on update/default-media-text-align-to-none.


Test passed after 1 failed attempt on try/block-tools-marry-document-tools.


Test passed after 1 failed attempt on try/global-styles-style-engine.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on rnmobile/add-reassure-pt-2.


Test passed after 1 failed attempt on refactor/GradientPicker-typescript.


Test passed after 1 failed attempt on update/wp-prettier-2.8.5.


Test passed after 1 failed attempt on fix/cover-block-tests.


Test passed after 1 failed attempt on add-published-types-checker.


Test passed after 1 failed attempt on add/elements-variations-custom-css.


Test passed after 1 failed attempt on add/gutenberg_register_fonts_from_theme_json-tests.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on update-port-parsing.


Test passed after 1 failed attempt on fix/iframe-enqueuing.


Test passed after 1 failed attempt on try/wrapping-patterns-in-pattern-block.


Test passed after 1 failed attempt on update/tree-grid-readme-a11y.


Test passed after 1 failed attempt on try/pass-rich-text-value-to-store.


Test passed after 2 failed attempts on trunk.


Test passed after 1 failed attempt on fix/navigation-block-aria-expanded-on-hover.


Test passed after 1 failed attempt on browse-mode-navigation-options.


Test passed after 1 failed attempt on try/site-editor-library.


Test passed after 1 failed attempt on try/auto-inserting-block-patterns.


Test passed after 1 failed attempt on refactor/remove-unnecesary-select-all.


Test passed after 1 failed attempt on release/16.0.


Test passed after 1 failed attempt on add/list-experimental-api-matches.


Test passed after 1 failed attempt on add/list-experimental-api-matches.


Test passed after 1 failed attempt on update/move-reset-button-to-default-option.


Test passed after 1 failed attempt on add/distraction-free-to-site-editor.


Test passed after 1 failed attempt on refactor/playwright-performance-tests.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on update/patterns-to-list-all-template-part-areas.


Test passed after 1 failed attempt on fix/unique-global-font-sizes.


Test passed after 1 failed attempt on fix/unique-global-font-sizes.


Test passed after 1 failed attempt on revert-52227.


Test passed after 1 failed attempt on item/fix-focus-state-as-a.


Test passed after 1 failed attempt on try/display-archive-title.


Test passed after 1 failed attempt on update/loginout-spacing.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/dimensions-visualizers-avoid-errors.


Test passed after 1 failed attempt on create-block-interactive-template-v2.


Test passed after 1 failed attempt on create-block-interactive-template-v2.


Test passed after 1 failed attempt on fix/dimensions-panel-decode.


Test passed after 1 failed attempt on enhancement/patterns-sticky-header.


Test passed after 1 failed attempt on try/fn-revision.


Test passed after 1 failed attempt on rnmobile/add/e2e-util-addBlockUsingAppender.


Test passed after 1 failed attempt on improve/visual-editor-disabled-message.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on rnmobile/update-media-placeholders-and-block-outline.


Test passed after 1 failed attempt on wp/latest.


Test passed after 1 failed attempt on form-fields.


Test passed after 1 failed attempt on update/patterns-command.


Test passed after 1 failed attempt on fix/image-block-deprecation.


Test passed after 1 failed attempt on try/move-padding-background.


Test passed after 1 failed attempt on interactivity-store-json-encode-inside-render.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on revert/verse-disable-line-breaks.


Test passed after 1 failed attempt on i11y/remove-hyphen-from-hex-value.


Test passed after 1 failed attempt on rnmobile/0.69.4-upgrade-gradle-to-8.2.1-and-agp-to-8.0.2.


Test passed after 1 failed attempt on rnmobile/0.69.4-upgrade-gradle-to-8.2.1-and-agp-to-8.0.2.


Test passed after 1 failed attempt on components-ui-cleanup.


Test passed after 1 failed attempt on try/enfoce-prs-make-readonly.


Test passed after 1 failed attempt on fix/52216.


Test passed after 1 failed attempt on rnmobile/non-functioning-gallery-caption-button.


Test passed after 1 failed attempt on rnmobile/non-functioning-gallery-caption-button.


Test passed after 1 failed attempt on fix/dfm-sidebar.


Test passed after 1 failed attempt on try/fonts-library-backend.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on components-ui-cleanup.


Test passed after 1 failed attempt on try/footnotes-disallow-in-patterns-prevent-duplication.


Test passed after 1 failed attempt on update/second-round-6-3-rc3.


Test passed after 1 failed attempt on docs/interactivity-api-package-README.


Test passed after 1 failed attempt on try/adding-more-block-instance-elements-support.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on update/block-editor-inserter-merge-patterns.


Test passed after 1 failed attempt on update/make-shortcuts-provider-optional-2.


Test passed after 1 failed attempt on try/perf-log-out-everything.


Test passed after 1 failed attempt on rnmobile/try/optional-chaining-reusableblock-call.


Test passed after 1 failed attempt on try/fixed-fonts.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on fix/drag-over-iframe-positioning.


Test passed after 1 failed attempt on trunk.


Test passed after 1 failed attempt on 6.4-rc1-2.


Test passed after 1 failed attempt on add/e2e-utils-editor-preferences.


Test passed after 1 failed attempt on test/ignore-android-build-files.


Test passed after 1 failed attempt on update/selector-scoping-utils. ``` Test timeout of 100000ms exceeded. ```
JustinyAhin commented 2 years ago

I run the test 15 times using for i in {1..15}; do npm run test-e2e -- packages/e2e-tests/specs/editor/various/preview.test.js; done and I was not able to reproduce the test fail.

Needs more investigation.

JustinyAhin commented 2 years ago

I run the test 15 times using for i in {1..15}; do npm run test-e2e -- packages/e2e-tests/specs/editor/various/preview.test.js; done and I was not able to reproduce the test fail.

Needs more investigation.

This test just fails in another PR checks (https://github.com/WordPress/gutenberg/pull/35534/checks?check_run_id=3867384922#step:6:66) so, definitely need more digging.

JustinyAhin commented 2 years ago

I can now reproduce

Mamaduka commented 2 years ago

@JustinyAhin, let me know if you need help with testing or code to fix this issue.

Mamaduka commented 2 years ago

I also tried to debug this issue but wasn't able to find the solution. It looks like tests started failing on the trunk after #34731.

Based on artifact Preview dropdown isn't open after the post is published: https://github.com/WordPress/gutenberg/blob/17bdf97b7ecfe579dfac10b415b84cf959865fdf/packages/e2e-tests/specs/editor/various/preview.test.js#L155-L161

cc @ellatrix

Screenshot

should open a preview window for a new post 2021-10-12T15-16-32 .

ellatrix commented 2 years ago

Hm, not sure how the PR affected this test. I guess we can revert it for now.

ellatrix commented 2 years ago

Let's see if @ntsekouras's PR fixes it :)

github-actions[bot] commented 1 year ago

This issue has gone 30 days without any activity.