Open shivanraptor opened 11 months ago
After a dig in the old issues, I thought this issue was fixed in https://github.com/jacksonllee/pycantonese/issues/32#issuecomment-1268983221, but it isn't.
主要係因為呢個 https://github.com/jacksonllee/pycantonese/pull/35 未解決所以一直都未發佈更新。
I guess I have to wait then.
You can replace the space with some uncommon punctuations, such as "▁". And then skip it.
Describe the bug Segmenter removes space of English words in code-mixed sentence, for example this sentence:
To reproduce Here is the code:
The output is:
Expected behavior The expected output is:
or
System (please complete the following information):
3.4.0