search

mozilla / wpt-sync

Two-way repository sync between web-platform-tests and gecko
Other
9 stars 11 forks source link

Notify appropriate people about changes in expectation metadata #45

Open mjzffr opened 6 years ago

mjzffr commented 6 years ago

Record in the corresponding Bugzilla bug which tests have changed from "expected pass" to "expected fail" based on metadata updates done as a result of try pushes. Perhaps need-info specific people based on bug component?

Originally filed as https://github.com/mjzffr/version-control-tools/issues/16

jgraham commented 6 years ago

I think it would be neat if we needinfo'd the original test author if it's a gecko developer, particularly for disabled tests. Otherwise I think that needinfoing is probably the wrong approach since it will be rather aggressive. See also #7 which proposes a different approach based on the idea that some things should have long-lived bugs that can go into the normal triage process and will therefore be handled correctly.

mjzffr commented 6 years ago

Maybe set wptsync-disabled on bz whiteboard.

whimboo commented 6 years ago

I have seen a couple of disabled and expected to fail tests in the webdriver directory. All by accident. For each of those bug existed but we never really notified someone. This is bad because disabling tests will mostly be invisible.

We should really set needinfo? for the triage owner of the component the sync bug gets filed in. An example is: https://bugzilla.mozilla.org/show_bug.cgi?id=1439951

whimboo commented 2 years ago

@jgraham when has this been completed? I cannot see that someone got needinfo'ed on https://bugzilla.mozilla.org/show_bug.cgi?id=1793596 recently.

I'm reopening for now.