apertium / lttoolbox

Finite state compiler, processor and helper tools used by apertium
http://wiki.apertium.org/wiki/Lttoolbox
GNU General Public License v2.0
18 stars 22 forks source link

Index by codepoints in input_buffer + ignore ignored chars #151

Closed unhammer closed 2 years ago

unhammer commented 2 years ago

fixes #150 , no regressions on first 2381474 lines of dan.wiki | dan.automorf.bin, but one progression:

before: ^ængselretter/*ængselretter$ (note missing initial h!) after: ^hængselretter/hængsel<n><nt><sg><ind><cmp>+ret<n><ut><pl><ind>/hængsel<n><nt><sg><ind><cmp>+rette<n><ut><pl><ind>$ for input hængsel&shy;retter