search

flutter / flutter

Flutter makes it easy and fast to build beautiful apps for mobile and beyond
https://flutter.dev
BSD 3-Clause "New" or "Revised" License
166.68k stars 27.61k forks source link

Mac framework_tests_impeller is 2.08% flaky #158572

Open fluttergithubbot opened 1 week ago

fluttergithubbot commented 1 week ago

The post-submit test builder Mac framework_tests_impeller had a flaky ratio 2.08% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20framework_tests_impeller/3866 Commit: https://github.com/flutter/flutter/commit/4de32b870212f33610be0ec122001d695f373a77

Flaky builds: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20framework_tests_impeller/3866 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20framework_tests_impeller/3802 https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20framework_tests_impeller/3801

Recent test runs: https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac%20framework_tests_impeller

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Piinks commented 1 week ago

These failures were impeller golden file tests. It looks like we might have 2 slightly flaky golden file tests, or they changed repeatedly in recent commits. Will let the bot monitor and report back to confirm that these images are stable.