I have re-tested all of our test cases with HTML_CodeSniffer and updated the results accordingly. I tested with version 2.1.1 on 20 November 2017.
30 entries changed as a result of that, mostly to the better. That changed the overall barriers from 18%/20% to 23%/34%.
I have trouble categorising 3 test results:
Missing H1 was "not found" and I so far changed it to "issue found". HTMLCS shows an error saying: "The heading structure is not logically nested. This h2 element appears to be the primary document heading, so should be an h1 element." Although it definitely found there is an issue, I'm not sure if the error message is clear enough or it's rather a category of "different issue found".
Table has no table headings was "wrong issue reported" and I changed it to "user to check". HTMLCS's notice says: "This table appears to be a layout table. If it is meant to instead be a data table, ensure header cells are identified using th elements." Although it doesn't say the user should check anything, it questions which kind of table it is and says correctly to add table headers if it's a data table.
Image that conveys information has an empty alt attribute currently is categorised as "warning only" but I wonder if it should be "noticed but not a fail". HTMLCS's warning says: "Img element is marked so that it is ignored by Assistive Technology." It's quite confusing because they categorise it as a warning but the warning always shows whenever there is an image with an empty alt parameter. It doesn't say what to do about it either. I wonder if that's something which should be fixed in HTMLCS as being demoted to a nice instead together with some hint to check if being ignored by AT is correct here or not.
I have re-tested all of our test cases with HTML_CodeSniffer and updated the results accordingly. I tested with version 2.1.1 on 20 November 2017. 30 entries changed as a result of that, mostly to the better. That changed the overall barriers from 18%/20% to 23%/34%.
I have trouble categorising 3 test results: