Ingest WV01_Pan_L1B granules for year 2015 into Production

NASA-IMPACT / csdap-cumulus

SmallSat Cumulus Deployment

Other

1 stars 1 forks source link

Ingest WV01_Pan_L1B granules for year 2015 into Production #198

Closed krisstanton closed 1 year ago

krisstanton commented 1 year ago

[x] Ask Ed or Madhu to restore WV01_Pan_L1B granules for 2015 from Glacier (15 days) and generate UMM-G metadata files

[x] Once all metadata files are generated, in Prod, run Cumulus rule named WV01_Pan_L1B___1_2015:

DOTENV=.env.prod make bash
cumulus rules enable --name WV01_Pan_L1B___1_2015
cumulus rules run --name WV01_Pan_L1B___1_2015

[x] Query the CMR to check the hits count, indicating the granule count: https://cmr.earthdata.nasa.gov/search/granules.umm_json?short_name=WV01_Pan_L1B&temporal=2015-01-01T00:00:00Z,2015-12-31T23:59:59.999Z
[x] Confirm that ingested granules are visible via Earthdata Search: https://search.earthdata.nasa.gov/search?q=wv01&qt=2015-01-01T00%3A00%3A00.000Z%2C2015-12-31T23%3A59%3A59.999Z

jsrikish commented 1 year ago

Started ingestion at 8:29 AM cental 1,897 matching granules at 8.35 AM--In progress

jsrikish commented 1 year ago

235,457 matching granules at 7:58 pm--still in progress

jsrikish commented 1 year ago

268,087 matching granules in Earthdata. 282707 - UMM-G created by airflow

krisstanton commented 1 year ago

Reopening this ticket to complete ingest of some missing granules. We need to run an ingest of just the Last Day of Year to capture some granules that were missed on the first pass.

Commands Run

DOTENV=.env.prod make bash
cumulus rules add --data app/stacks/cumulus/resources/rules/WV01_Pan_L1B/v1/WV01_Pan_L1B___1_2015_Dec31.json
cumulus rules enable --name WV01_Pan_L1B___1_2015_Dec31
cumulus rules run --name WV01_Pan_L1B___1_2015_Dec31

krisstanton commented 1 year ago

775 granules found and ingested for 2015-12-31 00:00:00 to 2015-12-31 23:59:59 Verification URLs https://cmr.earthdata.nasa.gov/search/granules.umm_json?short_name=WV01_Pan_L1B&temporal=2015-01-01T00:00:00Z,2015-12-31T23:59:59.999Z https://search.earthdata.nasa.gov/search/granules?p=C2497387766-CSDA&pg[0][v]=f&pg[0][qt]=2015-12-31T00%3A00%3A00.000Z%2C2015-12-31T23%3A59%3A59.999Z&pg[0][gsk]=-start_date&q=wv01&tl=1692718563.581!3!! Granules ingested before this update: 268,087 Granules ingested after this update: 268,862