How long is the historic data available? Do you delete historic data when it reaches certain age?
Srecko:
We keep the data. With the query I gave you, it works with current index (alias) only, so older data might disappear once aliases are switched to a new set of indices. We do this few times in a year. I will probably soon switch aliases to 2017 set of indices, actually.
For historical access it is better to use special aliases which provide access to certain period, like a year. Those can be controlled using setup parameter of the API.
However it might take some time to respond when older, inactive indices are queried - or even get a timeout, because elasticsearch tends to flush rarely accessed data from cache, and it takes time to read it again from disk. So, for realtime usage it's best to stick to using "cdaq".
How long is the historic data available? Do you delete historic data when it reaches certain age?
Srecko: