Right now, ops will run tests on different platforms via containers (yay!) but it just executes the tests in containers serially. To determine if there was a failure, the user must scroll up and look through the terminal output. If there is a failure, the user must scroll up above that to the find the most recent line that says which container was being executed.
It would be nice to have RSpec roll up these results in a traditional RSpec report, or at least have a summary printed at the end.
Perhaps RSpec could execute the container runs, so that each platform appears as only one test. That isn't as good as having all tests rolled up and magically wrapped in a context like "when running on debian", but it is probably achievable. If there's a failure, the user can scroll up to look through the output for that container to see the details of the test run.
Another feature that would be useful with the above is if each container output was put in a text file, and printed in full if there was an error running tests in that container. This might even work without having RSpec run tests in each container as a single test...
Right now,
opswill run tests on different platforms via containers (yay!) but it just executes the tests in containers serially. To determine if there was a failure, the user must scroll up and look through the terminal output. If there is a failure, the user must scroll up above that to the find the most recent line that says which container was being executed.It would be nice to have RSpec roll up these results in a traditional RSpec report, or at least have a summary printed at the end.
Perhaps RSpec could execute the container runs, so that each platform appears as only one test. That isn't as good as having all tests rolled up and magically wrapped in a
contextlike "when running on debian", but it is probably achievable. If there's a failure, the user can scroll up to look through the output for that container to see the details of the test run.Another feature that would be useful with the above is if each container output was put in a text file, and printed in full if there was an error running tests in that container. This might even work without having RSpec run tests in each container as a single test...