pmelchior / scarlet

hyperspectral galaxy modeling and deblending
MIT License
50 stars 22 forks source link

Implement scarlet_test for regression testing #186

Closed fred3m closed 4 years ago

pmelchior commented 4 years ago

There are no issues about this PR on our end, but the workflow for scarlet_test should be streamlined. Right now, someone needs to manually create an PR, and Fred needs to manually run a git fixup.

I suggest that we check how to deploy the test results (a few numbers and several png figures) to a web server, e.g. an amazon bucket, and pull the figures from there by a dynamic website. This way, no PR in scarlet_test is needed, and we can load whatever branches we want to compare from the website.

fred3m commented 4 years ago

I looked into it and neither Google nor AWS have a free tier that includes cloud data any more (after the 1st 12 months). However, AMW has a DynamoDB that I think will work for our purposes and is actually the way I was originally thinking about this. So as long as I can get it setup properly all of the measurement data and residuals will be pushed to tables in the database that we can query in our docs. I'll look into this next week.