search

ARPA-SIMC / arkimet

A set of tools to organize, archive and distribute data files.
Other
15 stars 5 forks source link

invalid dates in arki-queries (and strange results) #324

Closed brancomat closed 7 months ago

brancomat commented 7 months ago

Apparently in older archives using invalid dates translates in a valid query for the first "real" following day:

$ arki-query --summary-short --dump "reftime:=2014-02-30 00:00" http://arkimet.metarpa:8090/dataset/lmsmr4x52
SummaryStats:
  Size: 3193369152
  Count: 17148
  Reftime: 2014-03-01T00:00:00Z to 2014-03-02T00:00:00Z
(...)

this is true for different datasets and wildly invalid dates:

arki-query --summary-short --dump "reftime:=2014-02-52 00:00" http://arkimet.metarpa:8090/dataset/eur025
SummaryStats:
  Size: 6386730160
  Count: 167510
  Reftime: 2014-03-01T00:00:00Z to 2014-03-24T00:00:00Z
(...)

but not for recent datasets:

$ arki-query --summary-short --dump "reftime:=2023-02-30 00:00" http://arkimet.metarpa:8090/dataset/ifs_ita010
SummaryStats:
  Size: 0
  Count: 0
  Reftime: 0000-00-00T00:00:00Z to 0000-00-00T00:00:00Z
Items:

It would be probably preferable to have an error when using an invalid date