zeptometer / satysfi-test

Write tests for SATySFi code
6 stars 0 forks source link

Create test run tool #5

Open zeptometer opened 3 years ago

zeptometer commented 3 years ago

Background

We can run tests by commands like satysfi --text-mode "text" main.test.saty -o report.txt. But this has some problems.

  1. The command is long and easy to miss
  2. It exits with status 0 even if the test fails

Goal

We should have a tool for executing tests, which wraps the non-essential complexity of running tests.

Notes

We already have test/run-tests.sh for running our tests. Maybe we can extend it as a general-purpose tool.

na4zagin3 commented 3 years ago

Shouldn’t Satyrographos support unit test execution? I’d like to help you.

zeptometer commented 3 years ago

@na4zagin3 You mean feature like npm test, or running tests during a publishing process? For the former, I feel it's good to have while not mandatory. For the latter, we should have it so that we can make sure that the package works in the snapshot. I'd love to discuss it, shall we have an offline meeting (not literally offline: zoom or somewhere else)?

na4zagin3 commented 3 years ago

@zeptometer I meant both because when running tests during a publishing process should be done by as simple commands as possible.

shall we have an offline meeting (not literally offline: zoom or somewhere else)?

Let's do that!