Element84 / earth-search

Earth Search information and issue tracking
https://earth-search.aws.element84.com/v1
30 stars 2 forks source link

S3 Inventory for collections in bucket e84-earth-search-sentinel-data #53

Open philvarner opened 1 month ago

philvarner commented 1 month ago

Is there, or can there be, an S3 Inventory created for the bucket that the new sentinel-2-c1-l2a COGs are in (e84-earth-search-sentinel-data)? Ideally, there would be per-collection inventories.

tylanderson commented 1 month ago

There is a S3 inventory available for data in sentinel-2-c1-l2a and sentinel-2-pre-c1-l2a collections. You can access the partitioned hive at s3://e84-earth-search-sentinel-data-inventory/e84-earth-search-sentinel-data/primary/hive/

This does not break out collections, but you can use the key property to filter by prefix to achieve the same result.

ircwaves commented 1 month ago

Might be time to start drafting the new landing page in RODA for the Collection 1 cogs, and add this info there.

philvarner commented 1 month ago

Yeah, we'd been waiting until all of C1 was indexed to do that, but that was when we thought completion was imminent. People are already starting to try to use it, so I think it's probably better to document it clearly (especially wrt the missing data).