search

rsignell-usgs / ooici-erddap

https://erddap-uncabled.oceanobservatories.org/uncabled/erddap/index.html
0 stars 0 forks source link

no data in last week on erddap #14

Open rsignell-usgs opened 6 years ago

rsignell-usgs commented 6 years ago

@kerfoot, This search for sea_water_temperature in the last week returned nothing. https://erddap-uncabled.oceanobservatories.org/uncabled/erddap/search/advanced.html?page=1&itemsPerPage=1000&searchFor=&protocol=%28ANY%29&cdm_data_type=%28ANY%29&institution=%28ANY%29&ioos_category=%28ANY%29&keywords=%28ANY%29&long_name=%28ANY%29&standard_name=sea_water_temperature&variableName=%28ANY%29&maxLat=&minLon=&maxLon=&minLat=&minTime=2017-12-04&maxTime=

What is the ETA for having data delivered on ERDDAP with latency less than 12 hours?

kerfoot commented 6 years ago

This appears to be a UFrame issue as no datasets have updated since Saturday, December 9. I will look into it deeper tomorrow and get back to you with an update.

rsignell-usgs commented 6 years ago

ping @jhtrowbridge

rsignell-usgs commented 6 years ago

@kerfoot kerfoot , looks like this has been fixed?

An advanced search for data in the last day now returns 276 datasets: https://erddap-uncabled.oceanobservatories.org/uncabled/erddap/search/advanced.html?page=1&itemsPerPage=1000&searchFor=&protocol=%28ANY%29&cdm_data_type=%28ANY%29&institution=%28ANY%29&ioos_category=%28ANY%29&keywords=%28ANY%29&long_name=%28ANY%29&standard_name=%28ANY%29&variableName=%28ANY%29&maxLat=&minLon=&maxLon=&minLat=&minTime=2017-12-28&maxTime=

and the data I checked looks okay: https://erddap-uncabled.oceanobservatories.org/uncabled/erddap/tabledap/CP02PMCI-WFP01-03-CTDPFK000-ctdpf_ckl_wfp_instrument-telemetered-deployment0009-tabledap.graph?time%2Cctdpf_ckl_seawater_pressure%2Cpractical_salinity&time%3E=now-2days&.draw=markers&.marker=4%7C7&.color=0x000000&.colorBar=%7C%7C%7C%7C%7C&.yRange=%7C%7Cfalse&.bgColor=0xffccccff

tabledap

rsignell-usgs commented 6 years ago

a query for all the data in the last day from this Pioneer profiler:

https://erddap-uncabled.oceanobservatories.org/uncabled/erddap/tabledap/CP02PMCI-WFP01-03-CTDPFK000-ctdpf_ckl_wfp_instrument-telemetered-deployment0009-tabledap.htmlTable?time%2Cctdpf_ckl_seawater_pressure%2Cpractical_salinity&time%3E=now-1day

indicates the most recent data for this dataset on ERDDAP is about 15-16 hours old.

@kerfoot , is that the expected lag time?

kerfoot commented 6 years ago

@rsignell-usgs The last record for this instrument that has been ingested by UFrame is from 2017-12-2819:39:17Z. The last record available on ERDDAP is from 2017-12-2819:39:17Z. So this data set is up to date. I don't have any way to check the raw data to see if this is an ingest issue or telemetry issue. Can't say whether it's "expected" or not, but the dataset is up to date with respect to what has been ingested.