lpjeosim-wetlandch4-daygrid-v2 further transformation

US-GHG-Center / ghgc-docs

https://us-ghg-center.github.io/ghgc-docs/

3 stars 2 forks source link

lpjeosim-wetlandch4-daygrid-v2 further transformation #64

Closed SwordSaintLancelot closed 4 months ago

SwordSaintLancelot commented 5 months ago

Transformation and ingestion

[x] Transform the received files' units (data * 86400) and upload them to the S3 bucket.
[x] Create a new STAC collection and ingest the data.
Generate the md5 values
[x] Generate the md5|sum for the raw files (files received from POC).
[ ] Generate the md5|sum for the transformed files.

PR for transforming the units. PR for creating the new STAC collection and ingesting the items.

SwordSaintLancelot commented 5 months ago

The script to fetch the data from S3 and upload the transformed data is written. The next step is to confirm the data transformation technique used by the POC.

SwordSaintLancelot commented 5 months ago

md5 sum was generated for the files received but was found to be different from the one provided by POC. Will follow up with the POC in this case.

Jeanne-le-Roux commented 4 months ago

Let's wrap up verifying the checksums post-release. I'm collecting a running list of updated related to documentation in this ticket: https://github.com/US-GHG-Center/ghgc-architecture/issues/207

US-GHG-Center / ghgc-docs

lpjeosim-wetlandch4-daygrid-v2 further transformation #64

Transformation and ingestion

Generate the md5 values