Windows test suite - Githubissues

bandframework / surmise

A python package for surrogate models that interface with calibration and other tools

https://surmise.readthedocs.io/en/latest/

MIT License

9 stars 6 forks source link

Windows test suite #115

Open mosesyhc opened 6 days ago

mosesyhc commented 6 days ago

Ensure test suite is run with Windows testing actions.

Following from #106

Also, the Windows testing actions logs do not suggest that the test suite was actually run. In particular, there is no standard output logging from your testing script.

mosesyhc commented 5 days ago

@jared321 : I attempted running the test suite on Windows in two ways:

run tox -e coverage within Windows Powershell to invoke the test suite. The tests are correctly run.
run .\tests\run-tests.sh directly in Powershell. The tests are also correctly run.
- Details: I had to reinstall cython (somehow pyximport is missing)

I am unsure how this would be different if run by the Windows actions. Any idea on how I can further test?

jared321 commented 5 days ago

Do you see the correct pytest output when you run locally? If so, then I would suggest

breaking a test,
run locally with tox to confirm that the test reports an error,
alter the GH action so that it will only run the windows tests,
commit the code that breaks the tests.

If the Windows CI tests are running but simply not logging the pytest standard output, you should see the Windows test fail. If the test doesn't fail, then run just the Ubuntu tests in the action. If that fails, then we have a problem.