ioos / system-test

IOOS DMAC System Integration Test project
github.com/ioos/system-test/wiki
The Unlicense
7 stars 14 forks source link

Travis test prototype. #152

Closed ocefpaf closed 10 years ago

ocefpaf commented 10 years ago

Implement a prototype for automated testing of notebooks. Should close #147.

birdage commented 10 years ago

@ocefpaf lets give this a whirl

ocefpaf commented 10 years ago

I will start a new PR testing the following alternatives:

This could be better for travis because it discovers cells as pytest tests: https://gist.github.com/timo/2621679

Very promising! I really like the comparison with the output that is stored in the notebook: https://gist.github.com/minrk/2620735

This one is just a better version of what we have now, it runs the cells and reports the exceptions: https://gist.github.com/gtfierro/9081920

birdage commented 10 years ago

@ocefpaf good job! i want to get it building and the bade added to the main page, then we can go about merging these purposed changes! nice work!

ocefpaf commented 10 years ago

If you want to add a badge you might consider skipping the test_notebooks.py and test_environments.py for now and run only the test_system-test_rules.py. As we progress with the testing framework we can turn test_notebooks.py and test_environments.py on again.

birdage commented 10 years ago

@ocefpaf sounds like a good plan, trying to find someone with admin access to at least get the ball rolling on the main SIT repo