w3c / aria-at-app

Test runner and results reporter for ARIA-AT
http://aria-at.w3.org/
Other
35 stars 15 forks source link

Issues raised through aria-at-app do not reference correct sequence number shown in the app #1110

Open howard-e opened 1 month ago

howard-e commented 1 month ago

Using the "Raise An Issue" button throughout the aria-at-app's test run page creates issues here with the incorrect sequence number.

These buttons are found on:

This probably happens because the app is using the presentationNumber value coming from tests.csv rather than using the generated sequence number when presented through the app.

This makes it confusing when reviewing issues created by the app and the issue claims it as being "Test 6" when the app reports the it as "Test 2" on any relevant pages which show a numbered sequence in the app.

This was raised in the May 22, 2024 CG meeting.

gnarf commented 1 month ago

To be clear - the "Test Number" should reference what is displayed on aria-at-app, however the presentationNumber of the test is probably still useful information to the aria-at maintainer and should be included in the issue text somewhere I think.