search

NASA-IMPACT / veda-data

4 stars 0 forks source link

New Dataset: MODIS Tri-Annual Differences #24

Closed acblackford closed 1 year ago

acblackford commented 1 year ago

Contact Details

acb0068@uah.edu

URL/DOI

No response

Data License Identifier

No response

Data Location

https://drive.google.com/drive/folders/18BAU77GH-TlAx1UOrszmYCO-bIVkxFP9?usp=drive_link

Size Estimate

700 MB

Number of Items

4

Description

MODIS difference cogs of LST Day , LST Night, NDVI, and WSA Albedo over the Camp Fire domain. Data should be centered on 0, (i.e., -1 to 1).

Collection Creation Notebook

No response

Item Creation Notebook

No response

Checklist

Any additional info you think is relevant, possibly including spatial or temporal subset if applicable?

No response

To Do

kathrynberger commented 1 year ago

Repeatedly receiving 422 Client Errors while trying to ingest this new dataset. I'm starting with the NDVI differences dataset first with the following code (see Gist).

I suspect that it has to do with the date formatting, but the error messages are unclear as to the root issue. I don't see any obvious errors, but would appreciate a second set of eyes on this @slesaad @ividito Thanks!

kathrynberger commented 1 year ago

Update on above errorrs: Currently seeking guidance on how to format target file name for files comparing two different time steps (e.g., CampFire_NDVI_2015_2022_diff_cog.tif).

Current regex: "filename_regex": "(.*)campfire_ndvi_{YEAR1}_{YEAR2}.tif$"

Returns the following error: "[{'loc': ('body', '__root__'), 'msg': \"Invalid sample files - ['s3://modis_diff/campfire_ndvi_{YEAR1}_{YEAR2}.tif'] do not match anyof the provided prefix/filename_regex combinations.\", 'type': 'value_error'}]"

Documentation only provides guidance for single time step or time range. cc' @slesaad @ividito

kathrynberger commented 1 year ago

As advised, four separate PRs were opened one for each of the following datasets included in this ticket:

kathrynberger commented 1 year ago

All of these datasets are now available in the stac catalog: https://staging-stac.delta-backend.com/collections/modis-ndvi-diff-2015-2022 https://staging-stac.delta-backend.com/collections/modis-lst-night-diff-2015-2022 https://staging-stac.delta-backend.com/collections/modis-lst-day-diff-2015-2022 https://staging-stac.delta-backend.com/collections/modis-albedo-wsa-diff-2015-2022

j08lue commented 1 year ago

Data seems to be ingested (via notebooks), but the PRs to add the collection metadata to this repo are still open - can they be merged, @slesaad?