Maelstrom is a fast Rust, Go, and Python test runner that runs every test in its own container. Tests are either run locally or distributed to a clustered job runner.
Use Cases
I'm writing tests in Python which are expected to fail, so they are annotated with xfail. I want to confirm what the failure that normally is being swallowed looks like, so I wish to run the tests and have them fail.
Acceptance Criteriamaelstrom-pytest has a new CLI option (not config option) called --runxfail that makes xfail tests fail.
Implementation Considerations
We should just forward this option along when invoking pytest to run a test.
Use Cases I'm writing tests in Python which are expected to fail, so they are annotated with
xfail. I want to confirm what the failure that normally is being swallowed looks like, so I wish to run the tests and have them fail.Acceptance Criteria
maelstrom-pytesthas a new CLI option (not config option) called--runxfailthat makesxfailtests fail.Implementation Considerations We should just forward this option along when invoking
pytestto run a test.Definition of Done
CHANGELOG.mdupdated.doc/book/headupdated.