web-platform-tests / interop

web-platform-tests Interop project
273 stars 28 forks source link

Move orphaned role tests into tentative files #645

Closed nmlapre closed 3 months ago

nmlapre commented 4 months ago

Test List

Rationale

Please see rationale in https://github.com/web-platform-tests/interop-accessibility/issues/109.

Since these tests aren't currently supported by the spec, I think we should move them to a .tentative file or files.

foolip commented 4 months ago

Is the proposal just to rename the tests to make clear they're not backed by a spec, or to also drop them from Interop 2024? We have on a few occasions included tentative tests, but it's worth flagging when we do that since the tests themselves are then the only guide to implementation.

nairnandu commented 4 months ago

@aleventhal could you please review the proposal for Chromium? @nt1m could you please review for WebKit?

nt1m commented 4 months ago

@cookiecrook Can you help review for WebKit?

aleventhal commented 4 months ago

I agree that there is no requirement for browsers to ignore orphaned roles where they are missing a required ancestor, etc. If we're ever going to make that a requirement it needs to be discussed in ARIA WG because of potential performance and behavioral regressions.

nmlapre commented 4 months ago

Is the proposal just to rename the tests to make clear they're not backed by a spec, or to also drop them from Interop 2024?

I'd prefer to drop the tests from Interop 2024, unless the ARIA spec issue is resolved quite soon. I was under the impression that renaming with .tentative was tantamount to removal for Interop 2024 (see comment here), but maybe I'm wrong on that. I'm happy to pull them out entirely.

cookiecrook commented 4 months ago

As mentioned in https://github.com/web-platform-tests/wpt/pull/45032, there are spec requirements in Core-AAM for this. The discussion is happening there, so I don’t think these tests will be pulled out of the Focus Area, until implementors wish to change Core-AAM.

There’s also an open ARIA Issue and an Interop-Accessibility issue: