search

projectatomic / vagrant-service-manager

To provide the user a CLI to configure the ADB/CDK for different use cases and to provide glue between ADB/CDK and the user's developer environment.
GNU General Public License v2.0
18 stars 16 forks source link

Provide custom Cucumber result formatter to make CI test results more readable #419

Closed hferentschik closed 8 years ago

hferentschik commented 8 years ago

https://www.relishapp.com/cucumber/cucumber/docs/formatters/formatter-api-step-file-path-and-line-number-issue-179

hferentschik commented 8 years ago

There is another idea which came to my mind and ties into some other potential improvement we discussed (about generating parts of the feature files). The idea would be to not use scenarios outlines with examples (which ultimately are skipped), but have a single scenario with some placeholder, but prior to actually executing the test we run a ruby task which fills in the right values, eg libvirt and adb. The then whole feature file is run without skips which makes the reporting easier. Obviously this Ruby/Rake tasks would not have to generate anything for non targeted combinations. Effectively we are externalizing how scenario outlines work for the benefit of a better understanding what is getting run and what is getting skipped.