Open 51-code opened 5 months ago
Describe the bug
I have a query that results in 10k rows of data: index=abc earliest=-3y@mon latest=-3y@d
index=abc earliest=-3y@mon latest=-3y@d
But when sorted: index=abc earliest=-3y@mon latest=-3y@d | sort _raw
index=abc earliest=-3y@mon latest=-3y@d | sort _raw
It results in only 5k rows of data.
Expected behavior
Sort shouldn't lose any data.
How to reproduce
Run the queries above.
Screenshots
Software version
PTH-10: 4.18.0-8-ge7e4190c
Desktop (please complete the following information if relevant):
Additional context
Probably a problem in the BatchCollect?
BatchCollect limits data to 5k rows by default, this can be changed with the dpl recall size config.
Should be noted that BatchCollect has skipLimiting parameter available, but it is not implemented.
Describe the bug
I have a query that results in 10k rows of data:
index=abc earliest=-3y@mon latest=-3y@d
But when sorted:
index=abc earliest=-3y@mon latest=-3y@d | sort _raw
It results in only 5k rows of data.
Expected behavior
Sort shouldn't lose any data.
How to reproduce
Run the queries above.
Screenshots
Software version
PTH-10: 4.18.0-8-ge7e4190c
Desktop (please complete the following information if relevant):
Additional context
Probably a problem in the BatchCollect?