Updated csv files not showing on FWC dash

[dotis]

The csv files for the FWC dash are updated in the databucket and the ts_ingest DAG is passing, but the dash is not updated. The latest time series values are from December 2023. I think this may be similar to a prior issue with the ingest script that was implemented when we had negative values for time on the first line of each csv.

[7yl4r]

This is a rather rare spot for breakage.

graph LR

manglillo --> data_bucket
data_bucket --> influxDB
influxDB -.-> grafana

Checking on the airflow job log for job ingest_sat_roi_GOM_VSNPP_sst_SOM. I see in grafana the corresponding latest data is 2023-12-05.

[...]
[2024-03-08 00:04:19,998] {subprocess.py:63} INFO - Running command: ['bash', '-c', 'curl --location --fail-with-body     https://raw.githubusercontent.com/7yl4r/extracted_sat_ts_gom_csv_data/main/data/GOMdbv2_sst_TS_VSNPP_daily_SOM.csv     > datafile.csv  && head datafile.csv  && curl --location --fail-with-body     --form measurement=vsnpp_sst     --form tag_set=location=SOM,sensor=vsnpp     --form fields=mean,climatology,anomaly     --form time_column=Time     --form file=@./datafile.csv     http://35.211.39.43:5000/submit/sat_image_extraction ']
[...]

The dag is still using github instead of the gbucket. I am updating the dag code for client-fwc branch using the client-fgbnms as a reference.

[dotis]

Ahh. Yes. I forgot to check that. Thanks @7yl4r