Polymer / tattoo

Test All The Things Over and Over
BSD 3-Clause "New" or "Revised" License
12 stars 3 forks source link

Upgrade tattoo to web-components-tester v6.0.0 #54

Closed usergenic closed 7 years ago

usergenic commented 7 years ago

Might as well release tattoo at 2.0.0 now that wct 6.0.0 is out.

usergenic commented 7 years ago

Sample output to demonstrate this works :)

(update-wct) * node ./lib/bin/tattoo.js -d /tmp/tat "polymerelements/iron-*#2.0-preview"
Searching for repos to test...           [=============================================] 100%
Getting Repo details from GitHub...      [=============================================] 100%
Cloning/Updating repos...                [=============================================] 100%
Installing dependencies with bower...    [=============================================] 100%
Testing 40 repo(s)...                    [=============================================] 100%
---
PolymerElements/iron-form#2.0-preview output:

Installing and starting Selenium server for local browsers
Selenium server running on port 54270
Web server running on port 2000 and serving from /private/tmp/tat/iron-form
chrome 58                Beginning tests via http://localhost:2000/components/iron-form/generated-index.html?cli_browser_id=0
chrome failed to maximize
404 GET /components/paper-styles/element-styles/paper-material.html
chrome 58                ✖ test/basic.html » resetting » can reset a form

  expected '{"input1":"input1","input2":"","check1":"on","radio1":"on","papercheck1":"on","paper1":"paper1","paper2":""}' to equal '{"input1":"input1","input2":"input2++","check2":"on","radio2":"on","papercheck2":"on","paper1":"paper1++","paper2":"paper2++"}'
    <unknown> at   HTMLElement.<anonymous> at basic.html:541:0

404 GET /components/paper-styles/element-styles/paper-material.html
chrome 58                ✖ test/basic.html » resetting » can reset a form

  expected '{"input1":"input1","input2":"","check1":"on","radio1":"on","papercheck1":"on","paper1":"paper1","paper2":""}' to equal '{"input1":"input1","input2":"input2++","check2":"on","radio2":"on","papercheck2":"on","paper1":"paper1++","paper2":"paper2++"}'
    <unknown> at   HTMLElement.<anonymous> at basic.html:541:0

chrome 58                Tests failed: 2 failed tests
Test run ended in failure: 2 failed tests

chrome 58 (34/0/2)

Error: 2 failed tests
---
PolymerElements/iron-icons#2.0-preview output:

Installing and starting Selenium server for local browsers
Selenium server running on port 53140
Web server running on port 2000 and serving from /private/tmp/tat/iron-icons
chrome 58                Beginning tests via http://localhost:2000/components/iron-icons/generated-index.html?cli_browser_id=0
chrome failed to maximize
chrome 58                ✖ test/iron-icons.html » <iron-icons> » basic behavior » all uniquely named

  expected true to be false
    <unknown> at   Context.<anonymous> at iron-icons.html:65:0

chrome 58                ✖ test/iron-icons.html » <iron-icons> » basic behavior » all uniquely named

  expected true to be false
    <unknown> at   Context.<anonymous> at iron-icons.html:65:0

chrome 58                Tests failed: 2 failed tests
Test run ended in failure: 2 failed tests

chrome 58 (0/0/2)

Error: 2 failed tests
---
PolymerElements/iron-location#2.0-preview output:

Installing and starting Selenium server for local browsers
Selenium server running on port 54510
Web server running on port 2000 and serving from /private/tmp/tat/iron-location
chrome 58                Beginning tests via http://localhost:2000/components/iron-location/generated-index.html?cli_browser_id=0
chrome failed to maximize
chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in default-after initialization

  expected '?default-value' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in attached-after initialization

  expected '?on-attached' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in ready-after initialization

  expected '?on-ready' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in default-below initialization

  expected '?default-value' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in attached-below initialization

  expected '?on-attached' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in ready-below initialization

  expected '?on-ready' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in default-after initialization

  expected '?default-value' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in attached-after initialization

  expected '?on-attached' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in ready-after initialization

  expected '?on-ready' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in default-below initialization

  expected '?default-value' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in attached-below initialization

  expected '?on-attached' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                ✖ test/initialization-tests.html » <iron-location>'s initialization » the url takes priority in ready-below initialization

  expected '?on-ready' to equal ''
    <unknown> at   <unknown> at initialization-tests.html:128:0

chrome 58                Tests failed: 12 failed tests
Test run ended in failure: 12 failed tests

chrome 58 (114/0/12)

Error: 12 failed tests
---
PolymerElements/iron-pages#2.0-preview output:

Installing and starting Selenium server for local browsers
Selenium server running on port 53958
Web server running on port 2000 and serving from /private/tmp/tat/iron-pages
chrome 58                Beginning tests via http://localhost:2000/components/iron-pages/generated-index.html?cli_browser_id=0
chrome failed to maximize
chrome 58 (22/0/4)

Error: 4 failed tests
---
PASSED: PolymerElements/iron-a11y-announcer#2.0-preview
PASSED: PolymerElements/iron-a11y-keys#2.0-preview
PASSED: PolymerElements/iron-a11y-keys-behavior#2.0-preview
PASSED: PolymerElements/iron-ajax#2.0-preview
PASSED: PolymerElements/iron-autogrow-textarea#2.0-preview
PASSED: PolymerElements/iron-behaviors#2.0-preview
PASSED: PolymerElements/iron-checked-element-behavior#2.0-preview
PASSED: PolymerElements/iron-collapse#2.0-preview
PASSED: PolymerElements/iron-component-page#2.0-preview
PASSED: PolymerElements/iron-demo-helpers#2.0-preview
PASSED: PolymerElements/iron-doc-viewer#2.0-preview
PASSED: PolymerElements/iron-dropdown#2.0-preview
PASSED: PolymerElements/iron-fit-behavior#2.0-preview
PASSED: PolymerElements/iron-flex-layout#2.0-preview
PASSED: PolymerElements/iron-form-element-behavior#2.0-preview
PASSED: PolymerElements/iron-icon#2.0-preview
PASSED: PolymerElements/iron-iconset#2.0-preview
PASSED: PolymerElements/iron-iconset-svg#2.0-preview
PASSED: PolymerElements/iron-image#2.0-preview
PASSED: PolymerElements/iron-input#2.0-preview
PASSED: PolymerElements/iron-jsonp-library#2.0-preview
PASSED: PolymerElements/iron-label#2.0-preview
PASSED: PolymerElements/iron-list#2.0-preview
PASSED: PolymerElements/iron-localstorage#2.0-preview
PASSED: PolymerElements/iron-media-query#2.0-preview
PASSED: PolymerElements/iron-menu-behavior#2.0-preview
PASSED: PolymerElements/iron-meta#2.0-preview
PASSED: PolymerElements/iron-overlay-behavior#2.0-preview
PASSED: PolymerElements/iron-range-behavior#2.0-preview
PASSED: PolymerElements/iron-resizable-behavior#2.0-preview
PASSED: PolymerElements/iron-scroll-target-behavior#2.0-preview
PASSED: PolymerElements/iron-scroll-threshold#2.0-preview
PASSED: PolymerElements/iron-selector#2.0-preview
PASSED: PolymerElements/iron-validatable-behavior#2.0-preview
PASSED: PolymerElements/iron-validator-behavior#2.0-preview
FAILED: PolymerElements/iron-form#2.0-preview
FAILED: PolymerElements/iron-icons#2.0-preview
FAILED: PolymerElements/iron-location#2.0-preview
FAILED: PolymerElements/iron-pages#2.0-preview
FAILED: PolymerElements/iron-test-helpers#2.0-preview

35 / 40 tests passed. 0 skipped.
tattoo: 366028.078ms