search

allenai / rslearn

A tool for developing remote sensing datasets and models.
Apache License 2.0
5 stars 0 forks source link

Datasets in S3 #27

Closed favyen2 closed 3 months ago

favyen2 commented 4 months ago

Eventually it should be easy to work with rslearn datasets that sit in S3.

For now we should make it seamless to train data from S3. Not sure if that means going through dataset like we did for multisat and putting each batch into a separate object, or just put each window as separate object, or something else.

favyen2 commented 4 months ago

Actually this is now about supporting rslearn datasets in S3-compatible object storage.