Earth-Information-System / fireatlas

3 stars 1 forks source link

Largefire NRT perimeter API data stopped in April #58

Open mccabete opened 1 month ago

mccabete commented 1 month ago

The data from the API feature collection public.eis_fire_lf_perimeter_nrt, stoped providing new data after April 2024-04-07T12:00:00+00:00. Is there something wrong with the API ingest script?

@ranchodeluxe

ranchodeluxe commented 1 month ago

The ingest seems to be working fine I see data for today (note the sortby and other query parameters)

https://firenrt.delta-backend.com/collections/public.eis_fire_snapshot_perimeter_nrt/items?limit=1000&sortby=-t&f=json

Screen Shot 2024-06-12 at 10 57 01 AM
ranchodeluxe commented 1 month ago

Though it is strange all those old timesteps are in there. The way to double check this is refer to the latest snapshot data in the bucket and do some checks but I'm guess the timestep column in there matches up.

The v2 legacy stuff decides t based on this: "SELECT n_pixels, n_newpixels, farea, fperim, flinelen, duration, pixden, meanFRP, isactive, t_ed as t, fireID from perimeter",

mccabete commented 1 month ago

I am talking specifically about the largefire features. public.eis_fire_lf_perimeter_nrt

ranchodeluxe commented 1 month ago

oh, yeah, sorry 😞 missed that _lf_ business. yeah, looks like that legacy job is not running 👍 good catch

mccabete commented 1 month ago

Full catch points go to @averyfratto!

ranchodeluxe commented 4 weeks ago

This is back online. Please confirm on your end @mccabete and close this if needed

Screen Shot 2024-06-18 at 5 11 46 AM