search

shaunxcode / edn-tests

common set of edn tests/large files for testing performance
4 stars 5 forks source link

test runners per platform #5

Open shaunxcode opened 11 years ago

shaunxcode commented 11 years ago

I think it would be cool to provide a test runner per implementation dir e.g. in js/jsedn/runner I will have:

All run-*-tests scripts will provide standard output (an edn map actually keyed by filename - for valid and invalid this will be true or false for values and for performance it will be microsecs test took as values) so it can be tested against other implementations.

I think this will be nice and platform agnostic whilst allowing each implementation to do what it needs setup wise.

Also this should make it easy to have an overall runner that runs all of them and collates the output (which I want to use to generate a nice gh-pages with).

igorw commented 11 years ago

It's probably overkill, but another thing worth looking at is Test Anything Protocol.

shaunxcode commented 11 years ago

I think TAP could be worth looking into. Right now I am going with expecting edn map as output. I have the clojure runner fully working now for run-valid-tests and outputting as mentioned.