HumanCellAtlas / table-testing

requirements, examples, and tests for expression matrix file formats
MIT License
22 stars 3 forks source link

Add tests for the merge task #13

Closed mckinsel closed 6 years ago

ryan-williams commented 6 years ago

this is really cool @mckinsel, sorry for the delay here! it's good to merge afaic

two ideas for developing this longer-term that come to mind are:

mckinsel commented 6 years ago

Thanks @ryan-williams ! Definitely agree about factoring the merge scripts better. Given that it's kind of early days, I'm leaning a little toward duplication rather than abstraction, but that'll have to change soon.

I made a few changes to run the tests multiple times, and now the table reports some summary stats for 10 executions. I also switched from EBS to a local SSD, which as expected changes things a lot. We'll have to think about recording those kinds of things nicely, but for now it's a note in the README.