In places the traversal graph may align small, high-frequency sequences that partition the token stream into, e.g., a long 4/2, then a small (spurious) alignment, and then a long 2/4, where other (better) alignments are available (cf. the online demo). The reason is not clear.
Example: ". i may add , that" (currently node #77).
In places the traversal graph may align small, high-frequency sequences that partition the token stream into, e.g., a long 4/2, then a small (spurious) alignment, and then a long 2/4, where other (better) alignments are available (cf. the online demo). The reason is not clear.
Example: ". i may add , that" (currently node #77).