This PR introduces an enhancement to the IsEastAsianWideRune function. The primary aim is to ensure that characters within the CJK Symbols and Punctuation range are correctly recognized as East Asian wide characters.
Rationale:
In the previous implementation, Japanese punctuation and certain related characters were not comprehensively covered. This oversight could lead to potential parsing inaccuracies when dealing with texts containing these characters. By extending support for these Unicode ranges, we can ensure a more accurate and inclusive representation of East Asian texts.
I appreciate any feedback and am open to making further adjustments if needed.
Description:
This PR introduces an enhancement to the
IsEastAsianWideRunefunction. The primary aim is to ensure that characters within the CJK Symbols and Punctuation range are correctly recognized as East Asian wide characters.Rationale:
In the previous implementation, Japanese punctuation and certain related characters were not comprehensively covered. This oversight could lead to potential parsing inaccuracies when dealing with texts containing these characters. By extending support for these Unicode ranges, we can ensure a more accurate and inclusive representation of East Asian texts.
I appreciate any feedback and am open to making further adjustments if needed.