web-platform-tests / wpt

Test suites for Web platform specs — including WHATWG, W3C, and others
https://web-platform-tests.org/
Other
5k stars 3.1k forks source link

Automate visual/manual CSS tests that pass somewhere but not everywhere #8670

Open gsnedders opened 6 years ago

gsnedders commented 6 years ago

The following table is derived from data from the CSS Test Harness, showing tests that are visual or manual tests and pass in at least one browser and fail in at least one. These are, therefore, the visual/manual CSS tests that are probably the highest priority to automate given they reveal interoperability issues.

path Blink EdgeHTML Gecko WebKit
css/CSS2/backgrounds/background-attachment-005.xht fail unknown pass pass
css/CSS2/backgrounds/background-attachment-006.xht fail unknown pass pass
css/CSS2/backgrounds/background-attachment-007.xht fail unknown pass pass
css/CSS2/backgrounds/background-attachment-008.xht fail unknown pass pass
css/CSS2/backgrounds/background-attachment-010.xht pass unknown pass fail
css/CSS2/backgrounds/background-position-applies-to-003a.xht pass unknown pass fail
css/CSS2/bidi-005.xht pass pass fail pass
css/CSS2/bidi-006.xht pass pass fail pass
css/CSS2/bidi-007.xht pass pass fail pass
css/CSS2/bidi-008.xht pass pass fail pass
css/CSS2/bidi-010.xht pass pass fail pass
css/CSS2/bidi-overflow-scroll-001.xht pass unknown fail pass
css/CSS2/bidi-text/direction-applies-to-010.xht pass fail pass pass
css/CSS2/box-display/block-in-inline-005.xht pass unknown pass fail
css/CSS2/box-display/containing-block-018.xht fail unknown pass pass
css/CSS2/box-display/containing-block-024.xht fail unknown pass pass
css/CSS2/box-display/containing-block-025.xht fail unknown fail pass
css/CSS2/cascade-import/cascade-import-005.xht fail unknown pass pass
css/CSS2/cascade-import/cascade-import-007.xht fail unknown unknown pass
css/CSS2/cascade/cascade-004.xht fail unknown pass pass
css/CSS2/cascade/cascade-006.xht fail unknown pass pass
css/CSS2/cascade/cascade-010.xht fail unknown pass pass
css/CSS2/cascade/cascade-011.xht fail unknown pass pass
css/CSS2/cascade/default-stylesheet-001.xht fail unknown pass pass
css/CSS2/cascade/specificity-012.xht pass unknown pass fail
css/CSS2/css1/c21-activ-ln-000.xht fail unknown pass pass
css/CSS2/css1/c21-focus-ln-000.xht fail unknown pass pass
css/CSS2/css1/c21-hover-ln-000.xht fail unknown pass pass
css/CSS2/css1/c21-pseud-anch-000.xht fail unknown pass pass
css/CSS2/css1/c21-pseud-link-000.xht fail unknown pass pass
css/CSS2/css1/c21-pseud-link-001.xht fail unknown pass pass
css/CSS2/css1/c21-pseud-link-002.xht fail unknown pass pass
css/CSS2/css1/c21-pseud-link-003.xht fail unknown pass pass
css/CSS2/css1/c23-first-line-000.xht fail unknown pass pass
css/CSS2/css1/c24-first-lttr-000.xht fail unknown pass pass
css/CSS2/css1/c26-psudo-nest-000.xht fail unknown pass pass
css/CSS2/css1/c411-vt-mrgn-000.xht fail unknown pass pass
css/CSS2/css1/c414-flt-000.xht fail unknown pass pass
css/CSS2/css1/c414-flt-001.xht fail unknown pass pass
css/CSS2/css1/c414-flt-002.xht fail unknown pass pass
css/CSS2/css1/c414-flt-003.xht fail unknown pass pass
css/CSS2/css1/c414-flt-ln-000.xht fail unknown pass pass
css/CSS2/css1/c414-flt-ln-001.xht fail unknown pass pass
css/CSS2/css1/c414-flt-ln-003.xht fail unknown pass pass
css/CSS2/css1/c523-font-style-000.xht fail fail pass pass
css/CSS2/css1/c526-font-sz-000.xht pass fail pass pass
css/CSS2/css1/c527-font-001.xht fail fail pass pass
css/CSS2/css1/c527-font-002.xht fail fail pass pass
css/CSS2/css1/c535-bg-fixd-000.xht fail unknown pass pass
css/CSS2/css1/c537-bgfxps-000.xht fail unknown pass pass
css/CSS2/css1/c544-valgn-000.xht fail unknown pass pass
css/CSS2/css1/c544-valgn-002.xht fail unknown pass pass
css/CSS2/css1/c544-valgn-003.xht fail unknown pass pass
css/CSS2/css1/c544-valgn-004.xht fail unknown pass pass
css/CSS2/css1/c545-txttrans-000.xht fail unknown pass pass
css/CSS2/css1/c546-txt-align-000.xht fail unknown pass pass
css/CSS2/css1/c5502-mrgn-r-002.xht fail unknown pass pass
css/CSS2/css1/c5505-mrgn-002.xht fail unknown pass pass
css/CSS2/css1/c5511-brdr-tw-000.xht fail unknown pass pass
css/CSS2/css1/c5512-brdr-rw-000.xht fail unknown pass pass
css/CSS2/css1/c5513-brdr-bw-000.xht fail unknown pass pass
css/CSS2/css1/c5514-brdr-lw-000.xht fail unknown pass pass
css/CSS2/css1/c5515-brdr-w-000.xht fail unknown pass pass
css/CSS2/css1/c5517-brdr-s-000.xht fail unknown pass pass
css/CSS2/css1/c5517-ibrdr-s-000.xht fail unknown pass pass
css/CSS2/css1/c5518-brdr-t-000.xht fail unknown pass pass
css/CSS2/css1/c5518-brdr-t-001.xht fail unknown pass pass
css/CSS2/css1/c5518-ibrdr-t-000.xht fail unknown pass pass
css/CSS2/css1/c5519-brdr-r-000.xht fail unknown pass pass
css/CSS2/css1/c5519-brdr-r-001.xht fail unknown pass pass
css/CSS2/css1/c5519-brdr-r-002.xht fail unknown pass pass
css/CSS2/css1/c5519-ibrdr-r-000.xht fail unknown pass pass
css/CSS2/css1/c5520-brdr-b-000.xht fail unknown pass pass
css/CSS2/css1/c5520-brdr-b-001.xht fail unknown pass pass
css/CSS2/css1/c5520-ibrdr-b-000.xht fail unknown pass pass
css/CSS2/css1/c5521-brdr-l-000.xht fail unknown pass pass
css/CSS2/css1/c5521-brdr-l-001.xht fail unknown pass pass
css/CSS2/css1/c5521-brdr-l-002.xht fail unknown pass pass
css/CSS2/css1/c5521-ibrdr-l-000.xht fail unknown pass pass
css/CSS2/css1/c5522-brdr-000.xht fail unknown pass pass
css/CSS2/css1/c5522-brdr-002.xht fail unknown pass pass
css/CSS2/css1/c5522-ibrdr-000.xht fail unknown pass pass
css/CSS2/css1/c5523-width-000.xht fail unknown pass pass
css/CSS2/css1/c5523-width-001.xht fail unknown pass pass
css/CSS2/css1/c5523-width-002.xht fail unknown pass pass
css/CSS2/css1/c5524-height-000.xht fail unknown pass pass
css/CSS2/css1/c5524-height-001.xht fail unknown pass pass
css/CSS2/css1/c5524-height-002.xht fail unknown pass pass
css/CSS2/css1/c5525-fltblck-001.xht fail unknown pass pass
css/CSS2/css1/c5525-fltwidth-000.xht fail unknown pass pass
css/CSS2/css1/c5525-fltwidth-002.xht fail unknown pass pass
css/CSS2/css1/c5526-flthw-000.xht fail unknown pass pass
css/CSS2/css1/c563-list-type-001.xht fail unknown pass pass
css/CSS2/css1/c564-list-img-000.xht fail unknown pass pass
css/CSS2/css1/c565-list-pos-000.xht fail unknown pass pass
css/CSS2/css1/c565-list-pos-001.xht fail unknown pass pass
css/CSS2/css1/c566-list-stl-001.xht fail unknown pass pass
css/CSS2/floats-clear/floating-replaced-height-008.xht unknown unknown pass fail
css/CSS2/floats-clear/floats-102.xht unknown unknown pass fail
css/CSS2/fonts/font-052.xht fail fail pass pass
css/CSS2/fonts/font-147.xht fail fail pass pass
css/CSS2/fonts/font-family-015.xht pass fail pass pass
css/CSS2/fonts/font-family-016.xht pass fail pass pass
css/CSS2/fonts/font-family-applies-to-003.xht pass fail pass pass
css/CSS2/fonts/font-family-rule-004a.xht pass fail pass pass
css/CSS2/fonts/font-size-114.xht fail fail pass pass
css/CSS2/fonts/font-size-rule-002.xht fail pass pass pass
css/CSS2/fonts/font-size-rule-004.xht fail pass pass pass
css/CSS2/fonts/font-weight-018.xht pass fail pass pass
css/CSS2/generate/list-style-position-001.xht unknown unknown pass fail
css/CSS2/generate/list-style-position-002.xht unknown unknown pass fail
css/CSS2/generate/list-style-position-003.xht unknown unknown pass fail
css/CSS2/generate/list-style-position-004.xht unknown unknown fail pass
css/CSS2/generate/list-style-position-011.xht unknown unknown pass fail
css/CSS2/generate/list-style-position-012.xht unknown unknown pass fail
css/CSS2/generate/list-style-position-014.xht unknown unknown pass fail
css/CSS2/generated-content/before-after-002.xht fail unknown pass pass
css/CSS2/generated-content/content-002.xht fail unknown pass pass
css/CSS2/generated-content/content-003.xht fail unknown pass pass
css/CSS2/generated-content/content-005.xht fail unknown pass pass
css/CSS2/generated-content/content-006.xht fail unknown pass pass
css/CSS2/generated-content/content-007.xht fail unknown pass pass
css/CSS2/generated-content/content-008.xht fail unknown pass pass
css/CSS2/generated-content/content-009.xht fail unknown pass pass
css/CSS2/generated-content/content-010.xht fail unknown pass pass
css/CSS2/generated-content/content-011.xht fail unknown pass pass
css/CSS2/generated-content/content-012.xht fail unknown pass pass
css/CSS2/generated-content/content-013.xht fail unknown pass pass
css/CSS2/generated-content/content-014.xht fail unknown pass pass
css/CSS2/generated-content/content-015.xht fail unknown pass pass
css/CSS2/generated-content/content-016.xht fail unknown pass pass
css/CSS2/generated-content/content-017.xht fail unknown pass pass
css/CSS2/generated-content/content-018.xht fail unknown pass pass
css/CSS2/generated-content/content-019.xht fail unknown pass pass
css/CSS2/generated-content/content-020.xht fail unknown pass pass
css/CSS2/generated-content/content-021.xht fail unknown pass fail
css/CSS2/generated-content/content-022.xht fail unknown pass fail
css/CSS2/generated-content/content-023.xht fail unknown pass fail
css/CSS2/generated-content/content-024.xht fail unknown pass fail
css/CSS2/generated-content/content-025.xht fail unknown pass fail
css/CSS2/generated-content/content-026.xht fail unknown pass fail
css/CSS2/generated-content/content-027.xht fail unknown pass fail
css/CSS2/generated-content/content-028.xht fail unknown pass fail
css/CSS2/generated-content/content-029.xht fail unknown pass fail
css/CSS2/generated-content/content-030.xht fail unknown pass fail
css/CSS2/generated-content/content-031.xht fail unknown pass fail
css/CSS2/generated-content/content-032.xht fail unknown pass fail
css/CSS2/generated-content/content-033.xht fail unknown pass fail
css/CSS2/generated-content/content-034.xht fail unknown pass fail
css/CSS2/generated-content/content-035.xht fail unknown pass fail
css/CSS2/generated-content/content-037.xht fail unknown pass pass
css/CSS2/generated-content/content-038.xht fail unknown pass pass
css/CSS2/generated-content/content-039.xht fail unknown pass pass
css/CSS2/generated-content/content-040.xht fail unknown pass pass
css/CSS2/generated-content/content-041.xht fail unknown pass pass
css/CSS2/generated-content/content-042.xht fail unknown pass pass
css/CSS2/generated-content/content-043.xht fail unknown pass pass
css/CSS2/generated-content/content-046.xht fail unknown pass pass
css/CSS2/generated-content/content-047.xht fail unknown pass pass
css/CSS2/generated-content/content-048.xht fail unknown pass pass
css/CSS2/generated-content/content-049.xht fail unknown pass pass
css/CSS2/generated-content/content-050.xht fail unknown pass pass
css/CSS2/generated-content/content-051.xht fail unknown pass pass
css/CSS2/generated-content/content-052.xht fail unknown pass pass
css/CSS2/generated-content/content-053.xht fail unknown pass pass
css/CSS2/generated-content/content-054.xht fail unknown pass pass
css/CSS2/generated-content/content-056.xht fail unknown pass pass
css/CSS2/generated-content/content-057.xht fail unknown pass pass
css/CSS2/generated-content/content-063.xht fail unknown pass pass
css/CSS2/generated-content/content-065.xht fail unknown pass pass
css/CSS2/generated-content/content-067.xht fail unknown pass pass
css/CSS2/generated-content/content-068.xht fail unknown pass pass
css/CSS2/generated-content/content-070.xht fail unknown pass pass
css/CSS2/generated-content/content-072.xht fail unknown pass pass
css/CSS2/generated-content/content-073.xht fail unknown pass pass
css/CSS2/generated-content/content-075.xht fail unknown pass pass
css/CSS2/generated-content/content-076.xht fail unknown pass pass
css/CSS2/generated-content/content-077.xht fail unknown pass pass
css/CSS2/generated-content/content-078.xht fail unknown pass pass
css/CSS2/generated-content/content-080.xht fail unknown pass pass
css/CSS2/generated-content/content-081.xht fail unknown pass pass
css/CSS2/generated-content/content-082.xht fail unknown pass pass
css/CSS2/generated-content/content-083.xht fail unknown pass pass
css/CSS2/generated-content/content-085.xht fail unknown pass pass
css/CSS2/generated-content/content-086.xht fail unknown pass pass
css/CSS2/generated-content/content-089.xht fail unknown pass pass
css/CSS2/generated-content/content-096.xht fail unknown pass pass
css/CSS2/generated-content/content-097.xht fail unknown pass pass
css/CSS2/generated-content/content-099.xht fail unknown pass pass
css/CSS2/generated-content/content-100.xht fail unknown fail pass
css/CSS2/generated-content/content-103.xht fail unknown pass pass
css/CSS2/generated-content/content-105.xht fail unknown pass pass
css/CSS2/generated-content/content-109.xht fail unknown pass pass
css/CSS2/generated-content/content-113.xht fail unknown pass pass
css/CSS2/generated-content/content-122.xht fail unknown pass pass
css/CSS2/generated-content/content-123.xht fail unknown pass pass
css/CSS2/generated-content/content-126.xht fail unknown pass pass
css/CSS2/generated-content/content-127.xht fail unknown pass pass
css/CSS2/generated-content/content-129.xht fail unknown pass pass
css/CSS2/generated-content/content-130.xht fail unknown pass pass
css/CSS2/generated-content/content-131.xht fail unknown pass pass
css/CSS2/generated-content/content-132.xht fail unknown pass pass
css/CSS2/generated-content/content-135.xht fail unknown pass pass
css/CSS2/generated-content/content-136.xht fail unknown pass pass
css/CSS2/generated-content/content-138.xht fail unknown pass pass
css/CSS2/generated-content/content-140.xht fail unknown pass pass
css/CSS2/generated-content/content-141.xht fail unknown pass pass
css/CSS2/generated-content/content-142.xht fail unknown pass pass
css/CSS2/generated-content/content-143.xht fail unknown pass pass
css/CSS2/generated-content/content-144.xht fail unknown pass pass
css/CSS2/generated-content/content-145.xht fail unknown pass pass
css/CSS2/generated-content/content-146.xht fail unknown pass pass
css/CSS2/generated-content/content-147.xht fail unknown pass pass
css/CSS2/generated-content/content-150.xht fail unknown pass pass
css/CSS2/generated-content/content-151.xht fail unknown pass pass
css/CSS2/generated-content/content-152.xht fail unknown pass pass
css/CSS2/generated-content/content-155.xht fail unknown pass pass
css/CSS2/generated-content/content-156.xht fail unknown pass pass
css/CSS2/generated-content/content-157.xht fail unknown pass pass
css/CSS2/generated-content/content-158.xht fail unknown pass pass
css/CSS2/generated-content/content-159.xht fail unknown pass pass
css/CSS2/generated-content/content-160.xht fail unknown fail pass
css/CSS2/generated-content/content-178.xht fail unknown pass pass
css/CSS2/generated-content/content-applies-to-001.xht fail unknown pass pass
css/CSS2/generated-content/content-attr-001.xht fail unknown pass pass
css/CSS2/generated-content/content-auto-reset-001.xht fail unknown pass pass
css/CSS2/generated-content/content-inherit-001.xht fail unknown pass pass
css/CSS2/generated-content/quotes-007.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-016.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-020.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-027.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-034.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-applies-to-005.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-applies-to-006.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-page-001.xht unknown unknown pass fail
css/CSS2/generated-content/quotes-repeat-001.xht unknown unknown pass fail
css/CSS2/i18n/syndata/character-encoding-001.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-002.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-003.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-004.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-005.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-006.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-007.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-008.xht fail unknown pass fail
css/CSS2/i18n/syndata/character-encoding-009.xht fail unknown pass fail
css/CSS2/i18n/syndata/character-encoding-010.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-011.xht fail unknown pass fail
css/CSS2/i18n/syndata/character-encoding-012.xht fail unknown pass fail
css/CSS2/i18n/syndata/character-encoding-013.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-014.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-015.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-016.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-019.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-020.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-021.xht fail unknown pass fail
css/CSS2/i18n/syndata/character-encoding-022.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-023.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-024.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-025.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-026.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-027.xht fail unknown pass pass
css/CSS2/i18n/syndata/character-encoding-029.xht fail unknown pass pass
css/CSS2/i18n/visuren/direction-unicode-bidi-027.xht unknown unknown pass fail
css/CSS2/linebox/vertical-align-boxes-001.xht unknown unknown pass fail
css/CSS2/lists/counter-increment-014.xht fail unknown pass pass
css/CSS2/lists/counter-increment-015.xht pass unknown fail fail
css/CSS2/lists/counter-increment-016.xht pass unknown fail fail
css/CSS2/lists/counter-increment-017.xht pass unknown fail fail
css/CSS2/lists/counter-increment-021.xht fail unknown pass pass
css/CSS2/lists/counter-increment-022.xht fail unknown pass pass
css/CSS2/lists/counter-increment-023.xht pass unknown fail fail
css/CSS2/lists/counter-increment-024.xht pass unknown fail fail
css/CSS2/lists/counter-increment-025.xht pass unknown fail fail
css/CSS2/lists/counter-increment-026.xht pass unknown fail fail
css/CSS2/lists/counter-increment-027.xht fail unknown pass pass
css/CSS2/lists/counter-increment-030.xht pass unknown fail pass
css/CSS2/lists/counter-increment-034.xht fail unknown pass pass
css/CSS2/lists/counter-increment-035.xht fail unknown pass pass
css/CSS2/lists/counter-increment-036.xht pass unknown fail pass
css/CSS2/lists/counter-increment-037.xht pass unknown fail pass
css/CSS2/lists/counter-increment-038.xht pass unknown fail fail
css/CSS2/lists/counter-increment-039.xht pass unknown fail fail
css/CSS2/lists/counter-increment-040.xht fail unknown pass pass
css/CSS2/lists/counter-increment-054.xht unknown unknown pass fail
css/CSS2/lists/list-style-013.xht unknown unknown pass fail
css/CSS2/lists/list-style-014.xht unknown unknown pass fail
css/CSS2/lists/list-style-015.xht unknown unknown pass fail
css/CSS2/lists/list-style-type-004.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-005.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-006.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-007.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-008.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-009.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-010.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-011.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-012.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-013.xht unknown unknown fail pass
css/CSS2/lists/list-style-type-014.xht unknown unknown fail pass
css/CSS2/margin-padding-clear/margin-collapse-012.xht unknown unknown pass fail
css/CSS2/margin-padding-clear/margin-collapse-107.xht unknown unknown pass fail
css/CSS2/margin-padding-clear/margin-collapse-109.xht unknown unknown pass fail
css/CSS2/margin-padding-clear/margin-collapse-160.xht unknown unknown pass fail
css/CSS2/normal-flow/inline-block-replaced-height-008.xht unknown unknown pass fail
css/CSS2/normal-flow/inline-replaced-height-008.xht unknown unknown pass fail
css/CSS2/normal-flow/min-height-applies-to-002.xht unknown unknown fail pass
css/CSS2/normal-flow/min-height-applies-to-003.xht unknown unknown fail pass
css/CSS2/normal-flow/min-height-applies-to-007.xht unknown unknown fail pass
css/CSS2/normal-flow/min-height-applies-to-013.xht unknown unknown fail pass
css/CSS2/normal-flow/min-height-applies-to-014.xht unknown unknown fail pass
css/CSS2/page-box/at-page-rule-002-a.xht pass fail pass pass
css/CSS2/page-box/at-page-rule-002-b.xht pass fail pass pass
css/CSS2/page-box/at-page-rule-002-c.xht pass fail fail pass
css/CSS2/page-box/first-page-selectors-001.xht unknown unknown fail pass
css/CSS2/page-box/first-page-selectors-003.xht unknown unknown pass fail
css/CSS2/page-box/page-box-000.xht pass fail pass pass
css/CSS2/page-box/page-container-001.xht pass fail pass fail
css/CSS2/page-box/page-container-003.xht fail pass pass pass
css/CSS2/page-box/page-container-004.xht fail fail fail pass
css/CSS2/page-box/page-container-005.xht pass fail pass pass
css/CSS2/page-box/page-container-008.xht pass fail pass pass
css/CSS2/page-box/page-container-009.xht pass fail pass pass
css/CSS2/page-box/page-container-010.xht pass pass pass fail
css/CSS2/page-box/page-grammar-001.xht fail fail pass pass
css/CSS2/page-box/page-grammar-002.xht fail fail fail pass
css/CSS2/page-box/page-margin-000.xht pass fail fail fail
css/CSS2/page-box/page-props-100-a.xht fail pass pass fail
css/CSS2/page-box/page-props-100-b.xht fail pass fail fail
css/CSS2/page-box/page-props-101.xht fail fail pass pass
css/CSS2/page-box/page-props-102.xht unknown unknown fail pass
css/CSS2/page-box/page-selectors-001.xht pass pass fail fail
css/CSS2/page-box/page-selectors-002.xht fail pass fail fail
css/CSS2/page-box/page-selectors-003.xht fail pass fail pass
css/CSS2/page-box/page-selectors-004.xht fail pass fail pass
css/CSS2/page-box/page-selectors-006.xht fail pass fail fail
css/CSS2/pagination/allowed-page-breaks-001a.xht pass fail pass pass
css/CSS2/pagination/allowed-page-breaks-001b.xht pass fail pass fail
css/CSS2/pagination/allowed-page-breaks-001c.xht pass fail pass fail
css/CSS2/pagination/allowed-page-breaks-002.xht pass unknown pass fail
css/CSS2/pagination/allowed-page-breaks-003.xht pass unknown pass fail
css/CSS2/pagination/allowed-page-breaks-005.xht pass unknown pass fail
css/CSS2/pagination/allowed-page-breaks-006.xht pass unknown pass fail
css/CSS2/pagination/allowed-page-breaks-007a.xht fail unknown pass pass
css/CSS2/pagination/allowed-page-breaks-007b.xht fail unknown pass fail
css/CSS2/pagination/orphans-001.xht fail pass fail fail
css/CSS2/pagination/orphans-002.xht unknown unknown pass fail
css/CSS2/pagination/orphans-004b.xht pass pass pass fail
css/CSS2/pagination/page-break-after-002.xht fail fail pass pass
css/CSS2/pagination/page-break-after-003.xht unknown unknown pass fail
css/CSS2/pagination/page-break-after-005.xht pass pass pass fail
css/CSS2/pagination/page-break-after-007.xht fail fail pass fail
css/CSS2/pagination/page-break-after-010.xht pass pass fail fail
css/CSS2/pagination/page-break-before-000.xht fail fail pass pass
css/CSS2/pagination/page-break-before-002.xht unknown unknown fail pass
css/CSS2/pagination/page-break-before-007-b.xht fail fail pass fail
css/CSS2/pagination/page-break-before-007.xht fail fail pass fail
css/CSS2/pagination/page-break-before-010.xht pass pass pass fail
css/CSS2/pagination/page-break-before-011.xht pass pass pass fail
css/CSS2/pagination/page-break-before-020.xht fail fail pass pass
css/CSS2/pagination/page-break-inside-000.xht unknown unknown pass fail
css/CSS2/pagination/page-break-inside-001.xht pass pass pass fail
css/CSS2/pagination/page-break-inside-002.xht unknown unknown pass fail
css/CSS2/pagination/page-break-inside-003.xht unknown unknown pass fail
css/CSS2/pagination/page-break-margins-002.xht unknown unknown fail pass
css/CSS2/pagination/page-break-margins-003.xht fail pass pass fail
css/CSS2/pagination/page-break-margins-004.xht pass pass pass fail
css/CSS2/pagination/page-breaks-100.xht fail pass pass fail
css/CSS2/pagination/page-breaks-101.xht pass fail pass fail
css/CSS2/pagination/widows-002.xht unknown unknown pass fail
css/CSS2/pagination/widows-004a.xht pass pass pass fail
css/CSS2/pagination/widows-004b.xht pass pass pass fail
css/CSS2/positioning/absolute-non-replaced-width-028.xht pass unknown fail pass
css/CSS2/positioning/abspos-023.xht pass unknown pass fail
css/CSS2/positioning/abspos-paged-001.xht pass unknown pass fail
css/CSS2/positioning/abspos-paged-002.xht pass unknown fail fail
css/CSS2/positioning/abspos-zero-width-001.xht pass unknown fail pass
css/CSS2/positioning/dynamic-top-change-005b.xht unknown unknown pass fail
css/CSS2/sec5/class-000.xht fail unknown pass pass
css/CSS2/sec5/class-001.xht fail unknown pass pass
css/CSS2/sec5/class-002.xht fail unknown pass pass
css/CSS2/selector/attribute-value-selector-009.xht pass unknown pass fail
css/CSS2/selector/lang-pseudoclass-002.xht unknown unknown pass fail
css/CSS2/selectors/class-selector-009.xht fail unknown pass pass
css/CSS2/selectors/class-selector-010.xht fail unknown pass pass
css/CSS2/selectors/class-selector-011.xht fail unknown pass pass
css/CSS2/selectors/class-selector-012.xht fail unknown pass pass
css/CSS2/selectors/first-letter-selector-000.xht unknown unknown fail pass
css/CSS2/selectors/first-letter-selector-009.xht unknown unknown fail pass
css/CSS2/selectors/first-letter-selector-010.xht unknown unknown fail pass
css/CSS2/selectors/first-letter-selector-029.xht unknown unknown fail pass
css/CSS2/selectors/first-line-selector-008.xht unknown unknown pass fail
css/CSS2/selectors/first-line-selector-011.xht unknown unknown pass fail
css/CSS2/selectors/first-line-selector-014.xht unknown unknown pass fail
css/CSS2/syntax/at-charset-013.html pass unknown pass fail
css/CSS2/syntax/character-representation-001.xht fail unknown pass pass
css/CSS2/tables/basic-css-table-001.xht fail unknown pass pass
css/CSS2/tables/border-collapse-initial-001.xht fail unknown pass pass
css/CSS2/tables/border-conflict-element-021a.xht pass unknown pass fail
css/CSS2/tables/border-style-inset-002.xht pass unknown pass fail
css/CSS2/tables/border-style-outset-002.xht pass unknown pass fail
css/CSS2/tables/caption-side-applies-to-001.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-002.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-005.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-006.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-007.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-008.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-009.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-010.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-011.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-012.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-015.xht fail unknown pass pass
css/CSS2/tables/caption-side-applies-to-017.xht fail unknown pass pass
css/CSS2/tables/caption-vs-table-box-001.xht fail unknown pass pass
css/CSS2/tables/caption-vs-table-box-002.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-001.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-002.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-003.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-004.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-005.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-006.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-007.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-008.xht fail unknown pass pass
css/CSS2/tables/collapsing-border-model-009.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-001.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-002.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-003.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-004.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-005.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-006.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-007.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-008.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-009.xht fail unknown pass pass
css/CSS2/tables/collapsing-table-borders-010.xht fail unknown pass pass
css/CSS2/tables/column-background-001.xht fail unknown pass pass
css/CSS2/tables/column-background-002.xht fail unknown pass pass
css/CSS2/tables/column-border-001.xht fail unknown pass pass
css/CSS2/tables/column-border-002.xht fail unknown pass pass
css/CSS2/tables/column-horizontal-alignment-001.xht fail unknown pass pass
css/CSS2/tables/column-horizontal-alignment-002.xht fail unknown pass pass
css/CSS2/tables/column-horizontal-alignment-003.xht fail unknown pass pass
css/CSS2/tables/column-horizontal-alignment-004.xht fail unknown pass pass
css/CSS2/tables/column-horizontal-alignment-005.xht fail unknown pass pass
css/CSS2/tables/column-visibility-001.xht fail unknown pass fail
css/CSS2/tables/column-visibility-002.xht fail unknown pass fail
css/CSS2/tables/column-visibility-003.xht fail unknown pass fail
css/CSS2/tables/column-width-001.xht fail unknown pass pass
css/CSS2/tables/column-width-002.xht fail unknown pass pass
css/CSS2/tables/columns-001.xht fail unknown pass fail
css/CSS2/tables/row-visibility-003.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-block-003.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-023.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-024.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-033.xht unknown unknown fail pass
css/CSS2/tables/table-anonymous-objects-034.xht unknown unknown fail pass
css/CSS2/tables/table-anonymous-objects-035.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-036.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-037.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-038.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-045.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-046.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-047.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-048.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-049.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-050.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-055.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-056.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-207.xht unknown unknown pass fail
css/CSS2/tables/table-anonymous-objects-208.xht unknown unknown pass fail
css/CSS2/tables/table-cell-001.xht fail unknown pass pass
css/CSS2/tables/table-cell-002.xht fail unknown fail pass
css/CSS2/tables/table-columns-example-001.xht unknown unknown pass fail
css/CSS2/tables/table-height-algorithm-012.xht unknown unknown pass fail
css/CSS2/tables/table-height-algorithm-023.xht unknown unknown pass fail
css/CSS2/tables/table-height-algorithm-024.xht unknown unknown pass fail
css/CSS2/tables/table-height-algorithm-025.xht unknown unknown pass fail
css/CSS2/tables/table-height-algorithm-032.xht unknown unknown pass fail
css/CSS2/tables/table-layer-transparency-003.xht unknown unknown pass fail
css/CSS2/text/combining-characters-002.xht fail unknown pass pass
css/CSS2/text/text-decoration-071.xht unknown unknown pass fail
css/CSS2/text/text-decoration-072.xht unknown unknown pass fail
css/CSS2/text/text-decoration-073.xht unknown unknown fail pass
css/CSS2/text/text-decoration-074.xht unknown unknown fail pass
css/CSS2/text/text-decoration-084.xht unknown unknown pass fail
css/CSS2/text/text-decoration-085.xht unknown unknown pass fail
css/CSS2/text/text-decoration-088.xht unknown unknown pass fail
css/CSS2/text/text-decoration-089.xht unknown unknown pass fail
css/CSS2/text/text-decoration-propagation-004.xht unknown unknown pass fail
css/CSS2/text/text-decoration-propagation-006.xht unknown unknown fail pass
css/CSS2/text/text-decoration-propagation-007.xht unknown unknown fail pass
css/CSS2/text/text-indent-010.xht unknown unknown pass fail
css/CSS2/text/text-indent-014.xht unknown unknown pass fail
css/CSS2/text/text-transform-bicameral-006.xht unknown unknown pass fail
css/CSS2/text/text-transform-bicameral-022.xht unknown unknown fail pass
css/CSS2/text/white-space-nowrap-attribute-001.xht unknown unknown pass fail
css/CSS2/ui/cursor-001.xht pass fail pass pass
css/CSS2/ui/cursor-009.xht fail fail pass pass
css/CSS2/ui/cursor-010.xht fail fail pass pass
css/CSS2/ui/outline-005.xht fail fail pass pass
css/CSS2/ui/outline-007.xht pass fail pass pass
css/CSS2/ui/outline-010.xht pass fail pass pass
css/CSS2/ui/outline-012.xht pass fail pass pass
css/CSS2/ui/outline-013.xht fail fail pass pass
css/CSS2/ui/outline-014.xht fail fail pass pass
css/CSS2/ui/outline-015.xht fail fail pass pass
css/CSS2/ui/outline-016.xht pass fail pass pass
css/CSS2/ui/outline-017.xht pass fail pass pass
css/CSS2/ui/outline-018.xht pass fail pass pass
css/CSS2/ui/outline-019.xht pass fail pass pass
css/CSS2/ui/outline-color-applies-to-004.xht unknown unknown pass fail
css/CSS2/ui/outline-layout-004.xht unknown unknown fail pass
css/CSS2/visufx/clip-100.xht fail unknown pass pass
css/CSS2/visufx/clip-101.xht fail unknown pass pass
css/CSS2/visufx/clip-inherit-001.xht fail unknown pass pass
css/CSS2/visufx/clip-non-absolute-001.xht fail unknown pass pass
css/CSS2/visufx/clip-shape-001.xht fail unknown pass pass
css/CSS2/visufx/clipping-017.xht fail unknown pass pass
css/CSS2/visufx/visibility-applies-to-005.xht unknown unknown pass fail
css/CSS2/visufx/visibility-applies-to-006.xht unknown unknown pass fail
css/compositing/text-with-svg-background.html pass fail pass pass
css/css-animations/animation-duration-003.html pass fail pass pass
css/css-animations/animation-fill-mode-001.html pass fail pass pass
css/css-animations/animation-fill-mode-003.html pass fail pass pass
css/css-animations/animation-iteration-count-006.html pass fail pass pass
css/css-backgrounds/background-attachment-fixed.html pass fail pass pass
css/css-backgrounds/background-attachment-local-scrolling.htm pass fail pass pass
css/css-backgrounds/background-clip/clip-border-box.html pass pass pass fail
css/css-backgrounds/background-clip/clip-border-box_with_position.html pass pass pass fail
css/css-backgrounds/background-clip/clip-border-box_with_radius.html pass pass pass fail
css/css-backgrounds/background-clip/clip-border-box_with_size.html pass pass pass fail
css/css-backgrounds/background-clip/clip-content-box.html pass pass pass fail
css/css-backgrounds/background-clip/clip-content-box_with_radius.html pass pass pass fail
css/css-backgrounds/background-clip/clip-content-box_with_size.html pass pass pass fail
css/css-backgrounds/background-origin/origin-border-box.html pass pass pass fail
css/css-backgrounds/background-origin/origin-border-box_with_position.html fail pass pass pass
css/css-backgrounds/background-origin/origin-content-box.html fail pass pass fail
css/css-backgrounds/background-origin/origin-content-box_with_size.html fail pass pass fail
css/css-backgrounds/background-origin/origin-padding-box.html pass pass pass fail
css/css-backgrounds/background-origin/origin-padding-box_with_position.html pass pass pass fail
css/css-backgrounds/background-origin/origin-padding-box_with_radius.html pass pass pass fail
css/css-backgrounds/background-size-aspect-ratio.htm pass fail pass fail
css/css-backgrounds/background_repeat_space_content_box.htm pass pass pass fail
css/css-backgrounds/border-image-slice-005.htm pass fail pass fail
css/css-backgrounds/border-image-slice-007.htm pass fail fail fail
css/css-backgrounds/border-radius-sum-of-radii-002.htm pass fail pass pass
css/css-backgrounds/ttwf-css3background-border-style-values.htm pass pass pass fail
css/css-color/hex-004.html pass fail pass pass
css/css-counter-styles/armenian/css3-counter-styles-008.html unknown unknown pass fail
css/css-counter-styles/cjk-decimal/css3-counter-styles-004.html fail unknown pass pass
css/css-counter-styles/cjk-earthly-branch/css3-counter-styles-203.html unknown unknown pass fail
css/css-counter-styles/cjk-heavenly-stem/css3-counter-styles-206.html unknown unknown pass fail
css/css-counter-styles/ethiopic-numeric/css3-counter-styles-068.html unknown unknown pass fail
css/css-counter-styles/ethiopic-numeric/css3-counter-styles-069.html unknown unknown pass fail
css/css-counter-styles/ethiopic-numeric/css3-counter-styles-070.html unknown unknown pass fail
css/css-counter-styles/hebrew/css3-counter-styles-016a.html pass fail fail fail
css/css-counter-styles/japanese-formal/css3-counter-styles-047.html fail fail pass fail
css/css-counter-styles/japanese-formal/css3-counter-styles-048.html fail fail pass fail
css/css-counter-styles/japanese-formal/css3-counter-styles-049.html unknown unknown pass fail
css/css-counter-styles/japanese-formal/css3-counter-styles-050.html pass unknown pass fail
css/css-counter-styles/japanese-formal/css3-counter-styles-051.html unknown unknown pass fail
css/css-counter-styles/japanese-informal/css3-counter-styles-042.html pass fail pass fail
css/css-counter-styles/japanese-informal/css3-counter-styles-043.html fail fail pass fail
css/css-counter-styles/japanese-informal/css3-counter-styles-044.html pass fail pass fail
css/css-counter-styles/japanese-informal/css3-counter-styles-045.html fail fail pass fail
css/css-counter-styles/japanese-informal/css3-counter-styles-046.html pass fail pass fail
css/css-counter-styles/korean-hanja-formal/css3-counter-styles-066.html unknown unknown pass fail
css/css-counter-styles/lower-armenian/css3-counter-styles-114.html unknown unknown pass fail
css/css-counter-styles/tamil/css3-counter-styles-146.html unknown unknown pass fail
css/css-counter-styles/tamil/css3-counter-styles-147.html unknown unknown pass fail
css/css-counter-styles/tamil/css3-counter-styles-148.html unknown unknown pass fail
css/css-counter-styles/upper-armenian/css3-counter-styles-109.html unknown unknown pass fail
css/css-display/run-in/clear-runin-001.xht pass unknown fail pass
css/css-display/run-in/display-004.xht unknown unknown fail pass
css/css-display/run-in/first-line-pseudo-009.xht unknown unknown fail pass
css/css-display/run-in/run-in-001.xht unknown unknown fail pass
css/css-display/run-in/run-in-002.xht unknown unknown fail pass
css/css-display/run-in/run-in-003.xht unknown unknown fail pass
css/css-display/run-in/run-in-005.xht unknown unknown fail pass
css/css-display/run-in/run-in-007.xht unknown unknown fail pass
css/css-display/run-in/run-in-inheritance-001.xht unknown unknown fail pass
css/css-display/run-in/run-in-linebox-002.xht unknown unknown fail pass
css/css-display/run-in/table-anonymous-block-001.xht unknown unknown pass fail
css/css-flexbox/flex-direction-row-vertical.html pass fail pass pass
css/css-flexbox/flexbox_stf-fixpos.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_break-after-column-item.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_break-after-column-lastitem.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_break-after-container.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_flex-basis-transitions.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_flex-shrink-transitions-invalid.html pass fail pass pass
css/css-flexbox/interactive/flexbox_interactive_flex-shrink-transitions.html pass fail pass pass
css/css-fonts/font-face-unicode-range-2.html pass pass pass fail
css/css-fonts/font-family-name-001.xht fail pass pass pass
css/css-fonts/font-family-name-002.xht fail pass pass pass
css/css-fonts/font-family-name-003.xht fail pass pass pass
css/css-fonts/font-family-name-004.xht fail pass pass pass
css/css-fonts/font-family-name-005.xht fail pass pass pass
css/css-fonts/font-family-name-006.xht fail pass pass pass
css/css-fonts/font-family-name-009.xht fail pass pass pass
css/css-fonts/font-family-name-012.xht fail pass pass pass
css/css-fonts/font-family-name-021.xht fail pass pass pass
css/css-fonts/font-family-name-023.xht fail pass pass pass
css/css-fonts/font-size-adjust-001.html pass fail pass pass
css/css-fonts/font-size-adjust-002.html pass fail pass pass
css/css-fonts/font-size-adjust-003.xht pass fail pass pass
css/css-fonts/font-variant-position-02.html fail fail pass pass
css/css-fonts/font-variant-position-03.html fail fail pass pass
css/css-fonts/font-weight-lighter-001.xht pass unknown pass fail
css/css-fonts/language-specific-01.html pass pass pass fail
css/css-gcpm/leader-001.html pass fail pass fail
css/css-gcpm/leader-002.html fail fail pass pass
css/css-gcpm/leader-003.html pass fail pass fail
css/css-gcpm/string-set-001.html pass fail pass fail
css/css-gcpm/string-set-002.html pass fail pass pass
css/css-gcpm/string-set-003.html pass fail pass pass
css/css-gcpm/string-set-004.html fail fail pass pass
css/css-gcpm/string-set-005.html fail fail pass pass
css/css-gcpm/string-set-006.html pass fail pass pass
css/css-gcpm/string-set-007.html pass fail pass pass
css/css-gcpm/string-set-008.html pass fail pass pass
css/css-gcpm/string-set-009.html pass fail pass pass
css/css-gcpm/string-set-010.html pass fail fail fail
css/css-gcpm/string-set-011.html pass fail fail pass
css/css-gcpm/string-set-012.html pass fail pass fail
css/css-gcpm/using-strings-001.html pass fail pass pass
css/css-gcpm/using-strings-002.html fail fail fail pass
css/css-gcpm/using-strings-003.html fail fail fail pass
css/css-gcpm/using-strings-005.html fail fail pass fail
css/css-images/img-orient-012.xht fail fail pass pass
css/css-page/page-background-000.xht pass fail pass pass
css/css-page/page-borders-000.xht pass fail pass pass
css/css-page/page-counters-000.xht fail fail pass pass
css/css-page/page-margin-003.xht pass fail pass pass
css/css-page/page-properties-000.xht fail fail pass pass
css/css-page/page-size-000.xht pass fail fail pass
css/css-page/page-size-002.xht fail fail pass pass
css/css-page/page-size-003.xht fail fail pass pass
css/css-page/page-size-004.xht fail fail fail pass
css/css-page/page-size-005.xht fail fail fail pass
css/css-page/page-size-006.xht fail fail fail pass
css/css-page/page-size-007.xht fail fail fail pass
css/css-page/page-size-009.xht pass fail pass fail
css/css-page/page-size-010.xht pass fail pass fail
css/css-regions/animations/animations-001.html pass fail pass pass
css/css-regions/interactivity/full-screen/fullscreen-region-content-004.html unknown unknown fail pass
css/css-regions/interactivity/hit-testing/css-cursor-001.html fail unknown fail pass
css/css-regions/interactivity/hit-testing/mouse-events-001.html unknown unknown pass fail
css/css-regions/interactivity/hit-testing/mouse-events-002.html unknown unknown pass fail
css/css-regions/interactivity/hit-testing/mouse-events-004.html unknown unknown pass fail
css/css-regions/interactivity/hit-testing/overflow-and-events-002.html unknown unknown pass fail
css/css-regions/interactivity/hit-testing/overflow-and-events-003.html unknown unknown pass fail
css/css-regions/interactivity/hit-testing/overflow-and-selection-002.html unknown unknown pass fail
css/css-regions/interactivity/keyboard/regions-keyboard-events-002.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-003.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-004.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-005.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-007.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-008.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-009.html unknown unknown fail pass
css/css-regions/interactivity/keyboard/regions-keyboard-events-010.html unknown unknown fail pass
css/css-regions/interactivity/mouse/regions-mouse-events-002.html unknown unknown pass fail
css/css-regions/interactivity/mouse/regions-mouse-events-009.html unknown unknown pass fail
css/css-regions/interactivity/selection/regions-selection-001.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-002.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-003.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-004.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-005.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-006.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-012.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-016.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-018.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-021.html unknown unknown fail pass
css/css-regions/interactivity/selection/regions-selection-023.html unknown unknown pass fail
css/css-regions/stacking-context/javascript-stacking-context-002.html unknown unknown fail pass
css/css-text-decor/text-decoration-line-014.xht unknown fail pass pass
css/css-text-decor/text-decoration-visibility-011.xht unknown unknown fail pass
css/css-text-decor/text-decoration-visibility-012.xht unknown unknown fail pass
css/css-text-decor/text-emphasis-style-016.html unknown fail pass pass
css/css-transforms/css-transform-inherit-scale.html fail unknown pass pass
css/css-transitions/transition-property-020.html fail fail pass pass
css/css-transitions/transition-property-038.html fail fail pass pass
css/css-transitions/transition-property-039.html pass fail pass pass
css/css-transitions/transition-property-041.html fail fail pass pass
css/css-transitions/transition-property-042.html fail fail pass pass
css/css-transitions/transition-property-043.html fail fail pass pass
css/css-ui/caret-color-001.html pass fail pass pass
css/css-ui/caret-color-002.html pass fail pass pass
css/css-ui/caret-color-003.html pass fail pass pass
css/css-ui/caret-color-007.html pass fail pass pass
css/css-ui/caret-color-008.html pass fail pass pass
css/css-ui/caret-color-010.html pass fail pass pass
css/css-ui/caret-color-011.html pass fail pass pass
css/css-ui/caret-color-012.html pass fail pass pass
css/css-ui/caret-color-014.html pass fail pass pass
css/css-ui/caret-color-015.html pass fail pass pass
css/css-ui/caret-color-016.html pass fail pass pass
css/css-ui/caret-color-017.html pass fail pass pass
css/css-ui/cursor-001.html pass fail pass pass
css/css-ui/cursor-009.html fail fail pass pass
css/css-ui/cursor-010.html fail fail pass pass
css/css-ui/cursor-auto-002.html pass fail pass fail
css/css-ui/cursor-auto-003.html pass fail pass fail
css/css-ui/cursor-auto-004.html pass fail pass pass
css/css-ui/cursor-auto-007.html pass fail pass fail
css/css-ui/cursor-image-001.html pass fail pass pass
css/css-ui/cursor-image-002.html pass fail pass pass
css/css-ui/cursor-image-005-nfs.html fail fail pass pass
css/css-ui/cursor-image-005.html pass fail pass pass
css/css-ui/cursor-image-006.html fail pass fail fail
css/css-ui/cursor-image-007.html pass fail pass pass
css/css-ui/cursor-image-008.html pass fail pass pass
css/css-ui/cursor-image-010.html pass fail pass pass
css/css-ui/cursor-image-011.html pass fail pass pass
css/css-ui/cursor-image-012.html pass fail pass pass
css/css-ui/cursor-image-png-001.html pass fail pass pass
css/css-ui/cursor-image-png-002.html pass fail pass pass
css/css-ui/cursor-image-png-003.html pass fail pass pass
css/css-ui/cursor-image-png-004.html pass fail pass pass
css/css-ui/cursor-image-png-005.html pass fail pass pass
css/css-ui/cursor-image-png-006.html pass fail pass pass
css/css-ui/cursor-image-png-007.html pass fail pass pass
css/css-ui/cursor-image-png-008.html pass fail pass pass
css/css-ui/cursor-image-png-009.html pass fail pass pass
css/css-ui/cursor-image-png-010.html pass fail pass pass
css/css-ui/cursor-image-png-011.html pass fail pass pass
css/css-ui/cursor-image-png-012.html pass fail pass pass
css/css-ui/cursor-image-png-013.html pass fail pass pass
css/css-ui/cursor-image-png-014.html pass fail pass pass
css/css-ui/cursor-image-png-015.html pass fail pass pass
css/css-ui/cursor-image-png-016.html pass fail pass pass
css/css-ui/cursor-image-png-017.html pass fail pass pass
css/css-ui/cursor-image-png-018.html pass fail pass pass
css/css-ui/cursor-image-png-019.html pass fail pass pass
css/css-ui/cursor-image-png-020.html pass fail pass pass
css/css-ui/cursor-image-png-021.html pass fail pass pass
css/css-ui/cursor-image-png-022.html pass fail pass pass
css/css-ui/cursor-image-png-023.html pass fail pass pass
css/css-ui/cursor-image-png-024.html pass fail pass pass
css/css-ui/cursor-image-png-025.html pass fail pass pass
css/css-ui/cursor-image-png-026.html pass fail pass pass
css/css-ui/cursor-image-png-027.html pass fail pass pass
css/css-ui/cursor-image-png-028.html pass fail pass pass
css/css-ui/cursor-image-png-029.html pass fail pass pass
css/css-ui/cursor-image-png-030.html pass fail pass pass
css/css-ui/cursor-image-png-031.html pass fail pass pass
css/css-ui/cursor-image-png-032.html pass fail pass pass
css/css-ui/cursor-image-png-033.html pass fail pass pass
css/css-ui/cursor-image-png-034.html pass fail pass pass
css/css-ui/cursor-image-png-035.html pass fail pass pass
css/css-ui/cursor-image-png-036.html pass fail pass pass
css/css-ui/cursor-image-png-037.html pass fail pass pass
css/css-ui/cursor-image-png-038.html pass fail pass pass
css/css-ui/cursor-image-png-039.html pass fail pass pass
css/css-ui/cursor-image-png-040.html pass fail pass pass
css/css-ui/cursor-text-001.html fail fail pass fail
css/css-ui/cursor-text-002.html pass fail fail fail
css/css-ui/cursor-x-y-001.html pass fail pass pass
css/css-ui/cursor-x-y-002.html pass fail pass fail
css/css-ui/cursor-x-y-003.html pass fail pass pass
css/css-ui/nav-dir-001.html pass unknown fail fail
css/css-ui/nav-dir-002.html pass unknown fail pass
css/css-ui/nav-dir-003.html pass unknown fail pass
css/css-ui/nav-dir-004.html pass unknown fail pass
css/css-ui/nav-dir-missing-3.html pass unknown fail pass
css/css-ui/nav-dir-missing-4.html pass unknown fail pass
css/css-ui/nav-dir-target-001.html pass unknown fail pass
css/css-ui/nav-dir-target-002.html pass unknown pass fail
css/css-ui/nav-dir-target-003.html pass unknown fail pass
css/css-ui/nav-dir-target-004.html pass unknown fail pass
css/css-ui/nav-dir-target-005.html pass unknown fail pass
css/css-ui/nav-dir-target-006.html pass unknown fail pass
css/css-ui/nav-down-000.html pass unknown fail pass
css/css-ui/nav-down-001.html pass unknown fail pass
css/css-ui/nav-down-002.html fail unknown fail pass
css/css-ui/nav-down-003.html pass unknown fail pass
css/css-ui/nav-down-004.html pass unknown fail pass
css/css-ui/nav-down-005.html pass unknown fail pass
css/css-ui/nav-down-006.html pass unknown fail pass
css/css-ui/nav-down-007.html pass unknown fail pass
css/css-ui/nav-down-010.html pass unknown pass fail
css/css-ui/nav-down-011.html pass unknown fail pass
css/css-ui/nav-down-012.html pass fail pass pass
css/css-ui/nav-down-013.html pass unknown fail pass
css/css-ui/nav-down-014.html pass unknown fail pass
css/css-ui/nav-down-015.html pass unknown fail fail
css/css-ui/nav-left-001.html pass unknown fail pass
css/css-ui/nav-left-002.html fail unknown pass pass
css/css-ui/nav-left-003.html pass unknown fail pass
css/css-ui/nav-left-004.html pass unknown fail pass
css/css-ui/nav-left-005.html pass unknown fail pass
css/css-ui/nav-left-006.html pass unknown fail pass
css/css-ui/nav-left-007.html pass unknown pass fail
css/css-ui/nav-left-008.html pass unknown fail pass
css/css-ui/nav-left-009.html pass unknown fail pass
css/css-ui/nav-left-010.html pass unknown pass fail
css/css-ui/nav-left-011.html pass unknown fail pass
css/css-ui/nav-left-012.html fail unknown pass pass
css/css-ui/nav-left-013.html pass unknown fail pass
css/css-ui/nav-left-014.html pass unknown fail pass
css/css-ui/nav-left-015.html pass unknown fail pass
css/css-ui/nav-left-016.html pass unknown pass fail
css/css-ui/nav-right-000.html pass unknown pass fail
css/css-ui/nav-right-001.html pass unknown fail pass
css/css-ui/nav-right-002.html fail unknown pass pass
css/css-ui/nav-right-003.html pass unknown fail pass
css/css-ui/nav-right-004.html pass unknown fail pass
css/css-ui/nav-right-005.html pass unknown fail pass
css/css-ui/nav-right-006.html pass unknown fail pass
css/css-ui/nav-right-007.html pass unknown pass fail
css/css-ui/nav-right-008.html pass unknown fail pass
css/css-ui/nav-right-009.html pass unknown fail pass
css/css-ui/nav-right-010.html pass unknown pass fail
css/css-ui/nav-right-011.html pass unknown fail pass
css/css-ui/nav-right-012.html fail pass pass pass
css/css-ui/nav-right-013.html pass unknown fail pass
css/css-ui/nav-right-014.html pass unknown fail pass
css/css-ui/nav-right-015.html pass unknown fail pass
css/css-ui/nav-right-016.html pass unknown pass fail
css/css-ui/nav-up-000.html pass unknown pass fail
css/css-ui/nav-up-001.html pass unknown fail pass
css/css-ui/nav-up-002.html fail unknown fail pass
css/css-ui/nav-up-003.html pass unknown fail pass
css/css-ui/nav-up-004.html pass unknown fail pass
css/css-ui/nav-up-005.html pass unknown fail pass
css/css-ui/nav-up-006.html pass unknown fail pass
css/css-ui/nav-up-007.html pass unknown fail fail
css/css-ui/nav-up-008.html pass unknown fail pass
css/css-ui/nav-up-009.html pass unknown fail pass
css/css-ui/nav-up-010.html pass fail fail fail
css/css-ui/nav-up-011.html pass unknown fail pass
css/css-ui/nav-up-012.html pass unknown fail pass
css/css-ui/nav-up-013.html pass unknown fail pass
css/css-ui/nav-up-014.html pass unknown fail pass
css/css-ui/nav-up-015.html pass unknown fail fail
css/css-ui/nav-up-016.html pass unknown fail fail
css/css-ui/resize-001.html pass fail pass pass
css/css-ui/resize-002.html pass fail pass pass
css/css-ui/resize-003.html pass fail pass pass
css/css-ui/resize-006.html pass fail pass pass
css/css-ui/resize-012.html pass fail fail pass
css/css-ui/resize-015.html pass fail pass pass
css/css-ui/resize-016.html pass fail pass pass
css/css-ui/resize-017.html pass fail pass pass
css/css-ui/resize-018.html pass fail pass pass
css/css-ui/resize-019.html pass fail pass fail
css/css-ui/resize-020.html pass fail pass fail
css/css-ui/resize-021.html pass fail pass pass
css/css-ui/select-cursor-001-manual.html pass fail pass pass
css/css-ui/text-overflow-018.html fail fail pass fail
css/css-ui/text-overflow-019.html fail fail fail pass
css/css-values/iframe/vh-support-transform-origin-iframe.html pass fail pass pass
css/css-values/iframe/vh-support-transform-translate-iframe.html pass fail pass unknown
css/css-writing-modes/block-plaintext-006.html pass fail pass pass
css/css-writing-modes/first-page-vrl-002.xht fail pass fail pass
css/css-writing-modes/form-controls-slr-004.xht fail fail pass unknown
css/css-writing-modes/form-controls-slr-005.xht fail fail pass unknown
css/css-writing-modes/form-controls-srl-004.xht fail fail pass unknown
css/css-writing-modes/form-controls-srl-005.xht fail fail pass unknown
css/css-writing-modes/form-controls-vlr-004.xht fail fail pass fail
css/css-writing-modes/form-controls-vlr-005.xht fail fail pass fail
css/css-writing-modes/form-controls-vrl-004.xht fail fail pass fail
css/css-writing-modes/form-controls-vrl-005.xht fail fail pass fail
css/css-writing-modes/margin-collapse-vlr-023.xht fail pass pass fail
css/css-writing-modes/margin-collapse-vrl-022.xht fail pass pass fail
css/css-writing-modes/outline-inline-slr-005.xht fail fail pass fail
css/css-writing-modes/outline-inline-srl-004.xht fail fail pass fail
css/css-writing-modes/outline-inline-vlr-003.xht pass pass pass fail
css/css-writing-modes/outline-inline-vlr-013.xht pass pass fail unknown
css/css-writing-modes/outline-inline-vrl-002.xht pass pass pass fail
css/css-writing-modes/outline-inline-vrl-012.xht pass pass fail unknown
css/css-writing-modes/page-flow-direction-slr-005.xht fail fail pass unknown
css/css-writing-modes/page-flow-direction-srl-004.xht fail fail pass unknown
css/css-writing-modes/replaced-content-image-002.xht pass fail pass pass
css/css-writing-modes/replaced-content-image-003.xht pass fail pass pass
css/css-writing-modes/text-orientation-mixed-slr-015.xht fail fail pass unknown
css/css-writing-modes/text-orientation-sideways-slr-019.xht fail fail pass unknown
css/css-writing-modes/text-orientation-upright-slr-017.xht fail fail pass unknown
css/css-writing-modes/text-underline-position-right-002.xht fail fail pass pass
css/css-writing-modes/text-underline-position-under-001.xht pass fail pass pass
css/css-writing-modes/underline-font-size-vlr-003.xht fail pass pass pass
css/css-writing-modes/underline-font-size-vlr-005.xht fail pass pass pass
css/css-writing-modes/underline-font-size-vrl-002.xht pass pass pass fail
css/css-writing-modes/underline-font-size-vrl-004.xht fail pass pass fail
css/css-writing-modes/underline-mixed-vrl-002.xht fail pass pass pass
css/css-writing-modes/vertical-alignment-slr-037.xht fail fail pass unknown
css/css-writing-modes/vertical-alignment-slr-039.xht fail fail pass unknown
css/css-writing-modes/vertical-alignment-srl-036.xht fail pass pass unknown
css/css-writing-modes/vertical-alignment-srl-038.xht fail fail pass unknown
css/selectors/hover-001-manual.html pass fail pass pass
css/vendor-imports/mozilla/mozilla-central-reftests/text3/text-align-match-parent-01.html unknown unknown pass fail

Here's a to-do list for tracking. It's known that not all of these can be automated currently; for those that can't be, they can be marked done when there's an issue for the reason they can't be automated and they should be annotated with that issue.

Tests done prior to regrouping

Visual tests

Tests flagged with: userstyle

Tests flagged with: paged

Tests flagged with: animated

Tests flagged with: interact, animated

Tests flagged with: interact

Tests flagged with: font

Tests flagged with: interact, paged

Tests flagged with: interact, history

gsnedders commented 6 years ago

Per spec, FWIW:

compositing: 1 css-color: 1 css-images: 1 css-transforms: 1 selectors: 1 vendor-imports: 1 css-values: 2 css-animations: 4 css-text-decor: 4 css-transitions: 6 css-flexbox: 8 css-display: 11 css-page: 14 css-fonts: 18 css-gcpm: 19 css-backgrounds: 22 css-counter-styles: 24 css-regions: 31 css-writing-modes: 36 css-ui: 165 CSS2: 517

gsnedders commented 6 years ago

css/vendor-imports/mozilla/mozilla-central-reftests/text3/text-align-match-parent-01.html is fixed in https://bugzilla.mozilla.org/show_bug.cgi?id=1427114

gsnedders commented 6 years ago

https://bugzilla.mozilla.org/show_bug.cgi?id=605520 is another potential source of failing CSS2 tests (though whether they pass in other browsers is another question!).

gregwhitworth commented 6 years ago

@gsnedders what engine builds did you test against for the above table?

gsnedders commented 6 years ago

@gregwhitworth It's simply done by counting results the CSS Test Harness has, and taking the majority result, all with no regard for browser versions. It's far from perfect, but the CSS Test Harness doesn't have results for the latest version of most browsers for most tests (heck, see all the tests with no Edge result).