Custom Partition Cache

[Ghnuberath]

• Custom partition LRU cache to replace https://github.com/hashicorp/golang-lru
• Cache is partitioned, including an in-memory uncompressed, in-memory compressed and on-disk component, allowing for flexible balancing of these three portions. Compressed memory allows more partitions to fit in-memory before having to swap to disk.
• Compression algorithm has been switched from lz4 to zstandard for superior compression ratios while retaining relevant throughput
• EDSM test has been switched to output multiple images to stress test the partition tree and new cache implementation

[codecov-commenter]

Codecov Report

Merging #16 into master will increase coverage by 0.75%. The diff coverage is 77.77%.

@@            Coverage Diff             @@
##           master      #16      +/-   ##
==========================================
+ Coverage   57.35%   58.10%   +0.75%     
==========================================
  Files          73       74       +1     
  Lines        5170     5296     +126     
==========================================
+ Hits         2965     3077     +112     
- Misses       1872     1877       +5     
- Partials      333      342       +9     

Impacted Files	Coverage Δ
internal/partition/row.go	44.14% <25.00%> (-1.44%)	:arrow_down:
internal/pcache/cache.go	74.33% <74.33%> (ø)
internal/dataframe/partition_tree.go	82.82% <80.00%> (+6.91%)	:arrow_up:
internal/partition/partition-reduceable.go	66.50% <81.81%> (+0.68%)	:arrow_up:
internal/partition/partition.go	87.09% <83.33%> (-1.92%)	:arrow_down:
cluster/s_partition.go	75.55% <89.47%> (+5.71%)	:arrow_up:
cluster/node.go	52.54% <100.00%> (+2.54%)	:arrow_up:
cluster/worker.go	72.41% <100.00%> (+0.23%)	:arrow_up:
internal/dataframe/partition_iterator.go	51.28% <100.00%> (-0.79%)	:arrow_down:
... and 2 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update e99f8ba...7955581. Read the comment docs.