Test runners provide a way to get a json file for `maelstrom-run` that runs the test exactly the same. - Githubissues

maelstrom-software / maelstrom

Maelstrom is a fast Rust, Go, and Python test runner that runs every test in its own container. Tests are either run locally or distributed to a clustered job runner.

https://maelstrom-software.com/

Apache License 2.0

599 stars 11 forks source link

Test runners provide a way to get a json file for `maelstrom-run` that runs the test exactly the same. #383

Open nfachan opened 3 months ago

nfachan commented 3 months ago

Use Cases

I have a test that fails for some mysterious reason. I want to be able to easily investigate from a TTY using the feature specified in #382 .
I want to manually run a test with slightly modified arguments or in a slightly modified container. I want to get a json file for the test, then modify it slightly and run it with maelstrom-run.

Acceptance Criteria

The user has a way to get a maelstrom-run json file for any test that has been run.
The json file should include everything necessary to create the container.
The json file should include the program and arguments used to run the test.

Implementation Considerations

Definition of Done

[ ] CHANGELOG.md updated.
[ ] Documentation in doc/book/head updated.
[ ] Issue is in the correct milestone.