w3c / iip

Documenting gaps and requirements for support of Indic languages on the Web and in eBooks.
https://w3c.github.io/iip/
8 stars 15 forks source link

Grapheme clusters fail to represent syllabic conjuncts #62

Closed r12a closed 3 years ago

r12a commented 4 years ago

The Unicode concept of 'grapheme cluster' currently fails to represent syllabic conjuncts (plus vowels, etc) in scripts like Bengali. Bengali is even more complex in this regards because it requires Ya-Phalaa after vowel which is formed by Vowel followed by Viaram(Hasant) and consonant combination, therefore breaking the basic notion of Akshar formation to represent the glyph(Ya-Phalaa/Ja-Phalaa). This means that various editing operations, line breaking algorithms, vertical text, etc. are likely to break text at the wrong point.

Indic Layout Requirements provides a grammar for indian orthographic syllable boundaries which works for Bengali, and CSS uses the concept of 'typographic character unit', rather than grapheme cluster, in its specs with the explanation that these cases are beyond the scope of the grapheme cluster concept and that implementations should provide appropriate support. In addition, a modification to the concept of grapheme cluster is currently in development at the Unicode Consortium, which is likely to resolve the problem for a script like Bengali.

See requirements at: Indic Layout Requirements

r12a commented 4 years ago

The first comment in this issue contains text that will automatically appear in the Bengali gap-analysis document as a subsection with the same title as this issue. Any edits made to that comment will be immediately available in the document. Proposals for changes or discussion of the content can be made in comments below this point.

r12a commented 3 years ago

Closed in favour of https://github.com/w3c/iip/issues/87