search

mitiko / BWDPerf

BWD stands for Best Word Dictionary as it has the ability to be an optimal dictionary coder.
https://mitiko.github.io/BWDPerf
GNU General Public License v3.0
0 stars 1 forks source link

Encoder only emits one word, when the same word gets matched multiple consecutive times #7

Closed mitiko closed 3 years ago

mitiko commented 3 years ago

The implementation of the splitting here: https://github.com/Mitiko/BWDPerf/blob/366b3b4dc0059df3431e70986370a3da27e05a05/src/Common/Algorithms/BWD/BWDEncoder.cs#L300-L306 ...will simply skip over consecutive words. I guess I was being lazy. Simple fix, just offset by the word length, don't try to do any funky business.