r-map / rmap

rete monitoraggio ambientale partecipativo documentation at https://doc.rmap.cc
https://rmap.cc
52 stars 43 forks source link

server:showdata timeseries with "big query" terminate with timeout #342

Open pat1 opened 3 years ago

pat1 commented 3 years ago

problem related to timeseries query with some filter from this "leveltype1", "l1", "leveltype2", "l2", "pindicator", "p1", "p2", "var" setted but not taken in account by arkimet query. the problem is more in evidence quering a big volume of data like not setting some of lat lon, ident, metwork with borinud terminated with timeout

is not possible to add this to filter the arkimet query becouse:

arkimet error: postprocessing is not possible when querying more than one dataset at the same time

one solution is to create a daily loop over the time range and filter the data like the bufr_filter postproc

pat1 commented 3 years ago

sample query: https://test.rmap.cc/borinud/api/v1/jsonline/*/*/*/254,0,0/1,-,-,-/B20003/timeseries/2020/01?dsn=report_fixed

pat1 commented 3 years ago

on the test server with less data the reponse come in time, on the oprative server with more data some tine the response do not come in time.