SuffolkLITLab / ALKiln

Integrated automated end-to-end testing with docassemble, puppeteer, and cucumber.
https://assemblyline.suffolklitlab.org/docs/alkiln/intro
MIT License
14 stars 4 forks source link

Report: Should we hide output of passing scenarios? #836

Open plocket opened 8 months ago

plocket commented 8 months ago

They're messy, but passing tests can be failures in disguise. For example, when some of the unused variables in a Story Table Step aren't used, that might actually be a failure. Counterpoints:

  1. Maybe that just shows a need for an enhancement to the Story Table step to let people assert that all variables are used.
  2. Part of the motivation for this is how messy passing tests can look. Mainly that's because of the trigger warning, which also makes failing tests messy and hard to pass. Maybe we should fix that before making a decision on this.