3-month ago first time I saw this benchmark https://h2oai.github.io/db-benchmark/ and confirmed real and amazing performance of Polars. Without seeing this, it will not motivate me had the energy to research in high performance algorithm.
I had solve out-of-memory issue for JoinTable with billions of rows. The testing machine has only 32GB memory and 8-Core CPU.
3-month ago first time I saw this benchmark https://h2oai.github.io/db-benchmark/ and confirmed real and amazing performance of Polars. Without seeing this, it will not motivate me had the energy to research in high performance algorithm. I had solve out-of-memory issue for JoinTable with billions of rows. The testing machine has only 32GB memory and 8-Core CPU.
I just published the pre-release 64-bit runtime of Peaks Consolidation] (https://github.com/hkpeaks/peaks-consolidation/releases/tag/v23.05.18) for Windows/Linux on . I’m so proud of this project because it makes the impossible possible.