We have a few different datasets that are stored (mostly on NERSC) with stuff we use for testing.
Mostly these are images, that are too large to keep in the repo itself.
We lazy download them, and have a cache system to not have to re-download them on local machines.
However, we should make sure all those files are stored in a reliable place (and maybe add mirrors?) so that folders don't suddenly move around and break our tests.
Once this is done, we can unite all the downloading in the test suite, and get rid of the ugly dropbox links that I've added in PR #191
guynir42
commented
4 months ago
We have a few different datasets that are stored (mostly on NERSC) with stuff we use for testing.
Mostly these are images, that are too large to keep in the repo itself.
We lazy download them, and have a cache system to not have to re-download them on local machines.
However, we should make sure all those files are stored in a reliable place (and maybe add mirrors?) so that folders don't suddenly move around and break our tests.
Once this is done, we can unite all the downloading in the test suite, and get rid of the ugly dropbox links that I've added in PR #191