search

allenai / rslearn

A tool for developing remote sensing datasets and models.
Apache License 2.0
5 stars 0 forks source link

Fix data sources that require local cache with new FileAPI system #37

Closed favyen2 closed 1 month ago

favyen2 commented 1 month ago

Resolves #31

favyen2 commented 1 month ago

This is WIP so far I just updated the aws_landsat data source.

I think remaining is to just update the rest of the data sources.

Once it's done, any cache directories needed by data sources can be specified relative to the underlying dataset path.

This might break existing configs.

As part of this I'm also adding integration tests for each data source.