search

HDFGroup / nasa_cloud

Apache License 2.0
3 stars 2 forks source link

Bucket cache for metadata #11

Closed jreadey closed 4 months ago

jreadey commented 1 year ago

Utilize S3 to enable persistent cache for dynamically extracted metadata.

jreadey commented 4 months ago

Dynamically extracted metadata (e.g. chunk locations retrieved by the DN node) are saved to S3 (or whatever storage system being used).