Closed jmalkin closed 7 years ago
Running with larger numbers of samples, the issue seems to be with the top level.
This commit (and the subsequent unit test) seem to have resolved the issue: https://github.com/DataSketches/sketches-core/commit/c44c7f4ec3213e4961ad0eaf4ab080b7798fb35d
Running the following code (yes, allocating way more memory than needed):
The base buffer seems ok, but data In the first level has unexpected 0.0s. If I use n = k * 4 + m, I was getting 0.0 values in the middle of the level.
Quantiles DirectDoublesSketch DATA DETAIL: