search

mitiko / BWDPerf

BWD stands for Best Word Dictionary as it has the ability to be an optimal dictionary coder.
https://mitiko.github.io/BWDPerf
GNU General Public License v3.0
0 stars 1 forks source link

Huge memory consumption #2

Closed mitiko closed 3 years ago

mitiko commented 3 years ago

The word selection phase takes almost 3GB of memory and re-runs multiple times, which is unnecessary. Use a location pointer matrix instead. Reproduction settings are r=8 m=24 b=1MB for enwik6