buildkite / test-engine-client

Buildkite Test Engine Client (bktec) is an open source tool to orchestrate your test suites. It uses your Buildkite Test Engine suite data to intelligently partition and parallelise your tests.
MIT License
9 stars 1 forks source link

Add option to set output file #167

Closed nprizal closed 2 months ago

nprizal commented 3 months ago

Description

in #156, we changed how we trigger the retry by saving the output of Rspec run to detect failed tests. The output of Rspec run was saved in a temporary file that will be deleted at the end of operation.

This PR adds a new option called BUILDKITE_SPLITTER_RESULT_PATH that can be used to specify the path to save the output of Rspec run. If the configured path has *, it will be replaced with a UNIX timestamp, this is useful when the retry function is enabled, and we want to store the output for each run separately without overriding the previous run.

Testing

I've done integration testing manually

nprizal commented 3 months ago

What happens if the configured path doesn't have * and retries are enabled? Does that mean it won't work properly?

@niceking It still works properly, because we interpret the report before we execute the retry runs. It just means that the result from retries will override the result from previous run(s).