PR #120 breaks some languages such as Japanese and Chinese.
For example:
GithubのVScode Github的VScode Github:
containsUTF8 will return true because it takes Githubの, のVScode,Github的 ,的VScode and Github: as a whole respectively, so the Github and VScode won't be corrected. UTF-8 support should be implemented in another way.
PR #120 breaks some languages such as Japanese and Chinese. For example:
GithubのVScode Github的VScode Github:
containsUTF8
will return true because it takesGithubの
,のVScode
,Github的
,的VScode
andGithub:
as a whole respectively, so theGithub
andVScode
won't be corrected. UTF-8 support should be implemented in another way.