openworm / ChannelWorm

Tools and curated datasets to build quantitative models of C. elegans ion channels
MIT License
12 stars 11 forks source link

Store output of SciUnit tests in S3 bucket #185

Closed gsarma closed 6 years ago

gsarma commented 7 years ago

SciUnit tests convey more information than ordinary unit tests. Ultimately, to have a standalone information dashboard for SciUnit, we would like to have the output of these tests stored in an S3 bucket.

See also: 1) https://github.com/joebowen/model_completion_dashboard 2) http://docs.openworm.org/en/latest/Projects/muscle-neuron-integration/#model-completion-dashboard 3) #184 and #186

@rgerkin @slarson @cheelee

rgerkin commented 7 years ago

@gsarma @slarson @cheelee I had originally envisioned using S3 for this, as Travis has very simple deployment of artifacts to S3 buckets.

However, S3 does cost money, and as cheap as it is (the bill will probably be in the ones of dollars total for the first few months) it will go up cumulatively as long as we are adding new testing artifacts. As we test more things, more often, this could conceivably grow larger than any person feels comfortable paying.

So I'd like to entertain a free option, like Google Drive. Thoughts?

gsarma commented 7 years ago

@rgerkin @slarson @cheelee

That sounds reasonable to me, and of course, we can shift things to S3 in the future if it seems like the right thing. As for now, will it be as straightforward as using S3?

Also referencing #144 and #145 as we should also be storing timing information in order to catch performance regressions.

rgerkin commented 7 years ago

Using OpenWorm S3 credentials provided by email.

gsarma commented 6 years ago

@rgerkin What is the status of this?