Linaro / lite-lava-docker-compose

LITE Team LAVA docker dispatcher
MIT License
5 stars 10 forks source link

[FYI] Test results notifications in SQUAD (qa-reports.linaro.org) #73

Open pfalcon opened 4 years ago

pfalcon commented 4 years ago

Given that we're withdrawing from using native LAVA notifications (e.g. https://review.linaro.org/c/ci/job/configs/+/35512), I'd like to post this ticket with a suggested alternative - using SQUAD notifications. To use them, you'd need to log in to qa-reports, then go to https://qa-reports.linaro.org/_/settings/subscriptions/ (or via menu: top right corner (account icon) -> Settings -> left navbar Subscriptions).

Unlike LAVA, which sends flat notifications regardless of success/failure status, SQUAD is more selective with notification type. It still lacks a type which I'd personally desire - "notification for as long as there's a failure" (jenkins-style). But I don't think we're ready for it anyway, because for now our jobs fail often or all-time non-deterministically, which means the same daily spam. Instead, we monitor for change in number of failures ;-) (or successes).

For reference, screenshot of my current settings are attached. The whole idea is that we experiment with the settings, and share feedback - first among themselves, then with QA team, if we confirm the need for improvements/new features.

Screenshot at 2020-06-03 14-32-57