search

web-platform-tests / wpt.fyi

web-platform-tests dashboard
https://wpt.fyi/
Other
182 stars 88 forks source link

view=test treats passing reftests as failing when query is used #3930

Open foolip opened 1 month ago

foolip commented 1 month ago

Compare these two views of view=subtest and view=test:

https://wpt.fyi/results/html/semantics/interactive-elements/the-dialog-element?label=master&label=stable&aligned&view=subtest https://wpt.fyi/results/html/semantics/interactive-elements/the-dialog-element?label=master&label=stable&aligned&view=test

These looks correct, no issue. However, adding feature:dialog to the query changes view=test radically:

https://wpt.fyi/results/html/semantics/interactive-elements/the-dialog-element?label=master&label=stable&aligned&view=subtest&q=feature%3Adialog https://wpt.fyi/results/html/semantics/interactive-elements/the-dialog-element?label=master&label=stable&aligned&view=test&q=feature%3Adialog

The passing reftests are now shown as failing, and the scores are much lower as a result.

@jcscottiii can you look into this?