clcr / pyeo

Python Earth Observation processing chain
GNU General Public License v3.0
94 stars 29 forks source link

Test Data Missing #73

Open kneave opened 3 years ago

kneave commented 3 years ago

In https://github.com/clcr/pyeo/blob/master/pyeo/tests/utilities.py there is a link to a zip file of test data: https://s3.eu-central-1.amazonaws.com/pyeodata/test_data.zip

It appears not to exist. Please provide an alternate link or instructions on how to generate this test dataset manually.

Thingus commented 3 years ago

Hi @kneave The test suite needs attention - it's gotten to the point where the test data folder stands at 45GB on my machine due to edge cases and unused data.

If you need to set up testing in the meantime, most of the test data points to either a raster file of some kind, a product from the relevant satellite, a folder containing said products or a simple vector file. The test.py files assume the following directory structure;

test_outputs can be empty - the outcomes from any tests will appear in there for inspection in GIS software.

I'll look into it and mark this issue closed when there's a test set of a sensible size that's hosted somewhere online.

kneave commented 3 years ago

Thanks Thingus, I'm working through the change_detection demo at the minute but thought it worth highlighting :)

Thingus commented 3 years ago

In that case, as a shameless shill; you may be interested in the following repo: https://github.com/clcr/pyeo_training_materials

It contains a set of notebooks and goes into more detail than the example script in the readme.

kneave commented 3 years ago

This is incredibly relevant to my interests, thank you!