Clay-foundation / model

The Clay Foundation Model (in development)
https://clay-foundation.github.io/model/
Apache License 2.0
299 stars 38 forks source link

Data pipeline modifier for c2smsfloods benchmark dataset #75

Closed lillythomas closed 2 months ago

lillythomas commented 9 months ago

Redux of the data pipeline to process the Cloud to Street - Microsoft Flood Dataset into datacubes along the lines of what our pretext model learned from.

Full raw dataset on S3 at s3://clay-benchmark/c2smsfloods/

Datacubes will be 512x512xC pixels due to the original chip size of the dataset.

Relates to https://github.com/Clay-foundation/office/issues/22.