Add GST CO2 dataset

[aboydnw]

• [x] Identify the point of contact and ensure someone is providing them updates:

• [ ] Data provider has read guidelines on data preparation

• [x] Identify data location: COGs are here: s3://veda-data-store-staging/EIS/CEOS_DATA/CO2_FLUX/pilot_topdown_CO2_Budget_grid_v1.COG/

• [x] Number of items: 16 (x6 items) + 16 std (x6 items) + 16 mean (x1 item) + 16 std mean (x1 item) : 16x4 collections

• [x] Verify that files are valid COGs (e.g. with rio cogeo validate)

• [x] Gather STAC collection metadata

• Title: National CO2 budgets (2015–2020) inferred from atmospheric CO2 observations in support of the global stocktake

• description: This dataset (Byrne et al. 2022) is described by Byrne et al. (2023) and consists of:

  • Top-down annual net land-atmosphere CO2 fluxes (NCE) from an ensemble of atmospheric CO2 inversions.
  • Bottom-up estimates of fossil fuel emissions and lateral carbon fluxes due to crop trade, wood trade, and river export.
  • Annual changes (loss) in terrestrial carbon stocks (ΔCloss) obtained by combining top-down and bottom-up estimates In addition, two metrics are provided to help users interpret country-level data:
  • The Z-statistics, which characterizes the differences between top-down NCE estimates.
  • The Fractional Uncertainty Reduction (FUR), which characterizes the impact of assimilated CO2 data on reducing NCE uncertainties.
  • These data are provided for the period 2015-2020 on both a global grid and as country-level totals with error characterization. Figures 1 and 2 illustrates how these carbon fluxes relate to each other and the methodology is described in more detail below.

• References:

  • Byrne, B., Baker, D. F., Basu, S., Bertolacci, M., Bowman, K. W., Carroll, D., Chatterjee, A., Chevallier, F., Ciais, P., Cressie, N., Crisp, D., Crowell, S., Deng, F., Deng, Z., Deutscher, N. M., Dubey, M. K., Feng, S., García, O. E., Herkommer, B., Hu, L., Jacobson, A. R., Janardanan, R., Jeong, S., Johnson, M. S., Jones, D. B. A., Kivi, R., Liu, J., Liu, Z., Maksyutov, S., Miller, J. B., Miller, S. M., Morino, I., Notholt, J., Oda, T., O’Dell, C. W., Oh, Y.-S., Ohyama, H., Patra, P. K., Peiro, H., Petri, C., Philip, S., Pollard, D. F., Poulter, B., Remaud, M., Schuh, A., Sha, M. K., Shiomi, K., Strong, K., Sweeney, C., Té, Y., Tian, H., Velazco, V. A., Vrekoussis, M., Warneke, T., Worden, J. R., Wunch, D., Yao, Y., Yun, J., Zammit-Mangion, A., and Zeng, N.: Pilot top-down CO2 Budget constrained by the v10 OCO-2 MIP Version 1, Committee on Earth Observing Satellites, https://doi.org/10.48588/npf6-sw92 , Version 1.0, 2022
  • Byrne, B., Baker, D. F., Basu, S., Bertolacci, M., Bowman, K. W., Carroll, D., Chatterjee, A., Chevallier, F., Ciais, P., Cressie, N., Crisp, D., Crowell, S., Deng, F., Deng, Z., Deutscher, N. M., Dubey, M. K., Feng, S., García, O. E., Griffith, D. W. T., Herkommer, B., Hu, L., Jacobson, A. R., Janardanan, R., Jeong, S., Johnson, M. S., Jones, D. B. A., Kivi, R., Liu, J., Liu, Z., Maksyutov, S., Miller, J. B., Miller, S. M., Morino, I., Notholt, J., Oda, T., O'Dell, C. W., Oh, Y.-S., Ohyama, H., Patra, P. K., Peiro, H., Petri, C., Philip, S., Pollard, D. F., Poulter, B., Remaud, M., Schuh, A., Sha, M. K., Shiomi, K., Strong, K., Sweeney, C., Té, Y., Tian, H., Velazco, V. A., Vrekoussis, M., Warneke, T., Worden, J. R., Wunch, D., Yao, Y., Yun, J., Zammit-Mangion, A., and Zeng, N.: National CO2 budgets (2015–2020) inferred from atmospheric CO2 observations in support of the global stocktake, Earth Syst. Sci. Data, 15, 963–1004, https://doi.org/10.5194/essd-15-963-2023 , 2023.

• license: (based on this list, we usually use CCO-1.0): That seems fine - use CCO-1.0

• Provider(s): Provide a link to list of contributors, call out international collaboration within the Discovery. Should be searchable.

• Processor: Not sure what to put here

• Licensor: Not sure what to put here

• temporal interval: (if this is consistent for all of these datasets, we can apply for all. please let us know if there are any differences though): 2015-2020

• whether it is periodic on the dashboard (periodic = regular time series of layers without gaps): (same as above, let us know if it's not consistent for every dataset): Yes, it is periodic

• the dashboard time density: (same as above, let us know if it's not consistent for every dataset) "year"; annual from 2015 through 2020

• Spatial extent/bounding box for the dataset: (same as above, let us know if it's not consistent for every dataset): Varies between datasets. Either country totals of 1x1 gridded.

• [ ] Review and follow https://github.com/NASA-IMPACT/cloud-optimized-data-pipelines/blob/main/OPERATING.md

• [ ] Open PR for publishing those datasets to the Staging API:

• [ ] Notify QA / move ticket to QA state

• [ ] Once approved, merge and close.

Notes

• External link to dataset paper with all providers
• In metadata, provide place to specify DOI for datasets - field for input providers?
• Target for EIS / VEDA
• Paper DOI: https://doi.org/10.5194/essd-15-963-2023
• Dataset DOI: https://doi.org/10.48588/npf6-sw92
• Byrne, B., Baker, D. F., Basu, S., Bertolacci, M., Bowman, K. W., Carroll, D., Chatterjee, A., Chevallier, F., Ciais, P., Cressie, N., Crisp, D., Crowell, S., Deng, F., Deng, Z., Deutscher, N. M., Dubey, M. K., Feng, S., García, O. E., Griffith, D. W. T., Herkommer, B., Hu, L., Jacobson, A. R., Janardanan, R., Jeong, S., Johnson, M. S., Jones, D. B. A., Kivi, R., Liu, J., Liu, Z., Maksyutov, S., Miller, J. B., Miller, S. M., Morino, I., Notholt, J., Oda, T., O'Dell, C. W., Oh, Y.-S., Ohyama, H., Patra, P. K., Peiro, H., Petri, C., Philip, S., Pollard, D. F., Poulter, B., Remaud, M., Schuh, A., Sha, M. K., Shiomi, K., Strong, K., Sweeney, C., Té, Y., Tian, H., Velazco, V. A., Vrekoussis, M., Warneke, T., Worden, J. R., Wunch, D., Yao, Y., Yun, J., Zammit-Mangion, A., and Zeng, N.

Resources on metadata

If not already familiar with these conventions for generating STAC collection and item metadata:

• Collections: https://github.com/NASA-IMPACT/delta-backend/issues/29 and STAC version 1.0 specification for collections
• Items: https://github.com/NASA-IMPACT/delta-backend/issues/28 and STAC version 1.0 specification for items
• NOTE: The delta-backend instructions are specific to datasets for the climate dashboard, however not all datasets are going to be a part of the visual layers for the dashboard so you can ignore the instructions that are specific to "dashboard" extension, "item_assets" in the collection and "cog_default" asset type in the item.

[aboydnw]

Update: currently waiting on metadata from EIS team via email

[slesaad]

@aboydnw sorry, this took so long, but i started looking at the cogs to get them published. looks like the cogs are invalid, i can't get them to open in qgis or in the titiler cog viewer 🤷

[aboydnw]

Thanks Slesa. I sent Brendan an email (who I think can help with this) and cc'ed you on it

[slesaad]

Hi @bkabyrne we can continue the discussion here. Could you have a look at the COGs and see why it's not loading in GGIS or similar software?

[bkabyrne]

@slesaad - Ah, I did not import the dataset into veda, this was done by Matt Thill, I will add him to the email chain

[slesaad]

The dataset has been published. Two collections: https://staging-stac.delta-backend.com/collections/ceos-co2-flux-budgets https://staging-stac.delta-backend.com/collections/ceos-co2-flux-budgets-mean