search

hammad93 / hurricane-deploy

This creates email reports and hosts the REST API. The reports have tropical storm and hurricane forecasts from the hurricane-net model. The deployment repository for a hurricane forecasting system based on machine learning and deep learning methods.
MIT License
1 stars 0 forks source link

global data ingestion #9

Closed hammad93 closed 1 year ago

hammad93 commented 1 year ago

the current global data ingestion is based on a web scraper and is not technically supported. However, there is another option here, https://www.emc.ncep.noaa.gov/gc_wmb/vxt/DECKS/

Based on, https://www.emc.ncep.noaa.gov/gc_wmb/vxt/HWRF/index.php

The "a" files have the spaghetti models and the "b" files have the best track. Here's a document with more details, https://dtcenter.org/sites/default/files/community-code/hwrf/docs/users_guide/HWRF-UG-2018.pdf

reference page 153

hammad93 commented 1 year ago

although the direct data that we need aside from the NHC is available here, https://www.metoc.navy.mil/jtwc/jtwc.html?tropical

it's not clear how to ingest the data. there's an RSS feed but it's unclear how to use it effectively.

the data might be up to an hour old, but the FTP listing in the original issue description will suffice.

hammad93 commented 1 year ago

the current method is sufficient, there's logic to use the alternative.