Open 7yl4r opened 1 year ago
data pipeline :
flowchart TD
ERDDAP[("ERDDAP")]
MOTU[(MOTU)]
MOTU --> mirror_motu{mirror motu} --> ERDDAP
%% crontabed script to dl from MOTU
%% erddap config to include data from MOTU
local_files[".nc local files"]
ERDDAP -- "extractR" --> local_files
local_files -- polygon_subset --> csv_files
%% https://github.com/7yl4r/extracted_sat_ts_gom_csv_data
csv_upload{csv_upload}
csv_files --> csv_upload
gh[(github)]
csv_upload --> gh
gh --> dashboard
opened discussion thread on ERDDAP forum: https://groups.google.com/g/erddap/c/e_ey473ocAM
implementation started on the motu
branch but waiting to hear back from the forum before putting more work in
add mirrored product from MOTU.
https://my.cmems-du.eu/thredds/dodsC/cmems_obs-sl_glo_phy-ssh_my_allsat-l4-duacs-0.25deg_P1M-m
A .sh script is being added here to download the .nc files using methods described in https://github.com/noaa-onms/climate-dashboard/issues/3
Steps to complete: