mozilla-mobile / firefox-ios

Firefox for iOS
Mozilla Public License 2.0
12.23k stars 2.94k forks source link

Flaky test testTriggers() #21966

Open data-sync-user opened 2 months ago

data-sync-user commented 2 months ago

https://app.bitrise.io/insights/095364a9afb324b2/explore/tests?interval=daily&duration=P30D&app_slug=6c06d3a40422d10f&workflow=firefox_configure_build&pipeline=pipeline_build_and_test&tab=failure_rate&secondary_tab=related_test_case_runs&failure_rate_order_by=failure_count&failure_rate_order_by_direction=descending&test_case_name=testTriggers()&test_suite_name=ClientTests&module=NimbusMessagingTriggerTests

┆Issue is synchronized with this Jira Task

data-sync-user commented 2 months ago

➤ Cyndi Chin commented:

Seems to mainly be failing for automation/update-nimbus-experiments Module: NimbusMessagingTriggerTests

data-sync-user commented 2 months ago

➤ Cyndi Chin commented:

https://app.bitrise.io/build/daa75afe-0821-4a72-b968-b8e31f1f059d ( https://app.bitrise.io/build/daa75afe-0821-4a72-b968-b8e31f1f059d|smart-link )

data-sync-user commented 1 month ago

➤ Cyndi Chin commented:

This test seems to fail due to syntax error in our initial_experiments.json I wouldn’t say these are flaky. Added comment here to confirm since only PR I saw that was merged: https://github.com/mozilla-mobile/firefox-ios/pull/21673 ( https://github.com/mozilla-mobile/firefox-ios/pull/21673 )

data-sync-user commented 1 month ago

➤ Cyndi Chin commented:

Closing this ticket as done since I have not seen this error on other PRs and it seem like the errors are valid.