search

Polymer / tattoo

Test All The Things Over and Over
BSD 3-Clause "New" or "Revised" License
12 stars 3 forks source link

Suggested details to make summary of test results more useful #42

Open usergenic opened 7 years ago

usergenic commented 7 years ago

This came from discussion on Slack today with @cdata and @notwaldorf (mentioning here in case they want to follow the issue or make suggestions)

wct has this nice summary it updates:

chrome 57 ()                            chrome 54 ()                            firefox 50 ()                           safari 10.0.1 ()

Imagine running tattoo on 50 elements, all of which pass on chrome, canary, firefox, and all of which fail on safari, because selenium is borked. We get a report 0/50 passed, and now have to manually dig through text logs to see why -- vs. -- seeing a summary of like 

chrome 57 (179/0/0)                     chrome 54 (179/0/0)                     firefox 50 (179/0/0)                      safari 10.0.1 (error)

Can the tattoo summary output give some kind of summary/indication which browsers failed per element instead of just saying PASSED/FAILED/SKIPPED and the repo name?

PASSED: PolymerElements/cool-potatoes#2.0-preview
FAILED: PolymerElements/sour-bananas#2.0-preview (chrome 54 178/1/0) (safari 10.0.1 0/179/0)