translationCore does not correctly split words in language `my` in wA tool

[PhotoNomad0]

Story Explanation

User Story

translationCore does not correctly split words in language my in wA tool. See in this example USFM file: 57-TIT_myanmar_judson_1835_utf8.usfm.txt. It looks like the first word in 2:1 is split into two words and a letter is dropped. Notice the two words in the word list compared to one word in the source text:

Notes:

• This appears to be a tokenizer error.
• the bug is also present in a two year old issue: https://github.com/unfoldingWord/translationCore/issues/6788

Features / Specifications

• [ ]
• [ ]
• [ ]

Definition of Done

• [ ]
• [ ]
• [ ]

Additional Context

Mockups