search

Webhuis / Cfengine-debian

Intermediate Debian repository for continous upgrade of Cfengine.
Other
8 stars 7 forks source link

Adjust acceptance tests to print to stdout #55

Open ballock opened 10 years ago

ballock commented 10 years ago

Please contact me on my email address.

I am preparing another Debian-team meeting and I want to include you

Martin

When using pbuilder for package build, as is the case with both the Debian and Ubuntu archives, a failed acceptance test produces just an notion that '1' test failed, without any hint as how many of the acceptance tests failed, with what error message or whatsoever.

A regular action of pbuilder, one that I could not find a way around is cleaning up the environment after build, no matter if it was successful or not. All the logs with information on what actually went wrong goes to hell an we have no benefit of using a CI environment to gather the build outputs.

ballock commented 10 years ago

I found that 'testall' script in the acceptance tests has a '--printlog' option. Trying to have it executed from the makefile, nor even hardcoding it to true in the script itself does not help, so I guess the output of the testall script is redirected by some other wrapper. Can't find it, though.

At the same time, on a regular build, all the test errors are in tests/acceptance/workdir/*/test.log. If we could just print those to stdout on test error...

tzz commented 10 years ago

Well, can you set an environment variable? Is there anything to tell testall that it should print the errors to STDOUT?

bahamat commented 10 years ago

If this can be done easily, please do so. Otherwise this will be dropped before the freeze.