t-sin / inquisitor

Encoding/end-of-line detection and external-format abstraction for Common Lisp
34 stars 3 forks source link

Nikud tests in Hebrew #32

Open t-sin opened 7 years ago

t-sin commented 7 years ago

Hebrew traditional alphabet represent only consonants. Vowels has no correspond character. But it's inconvinient. Then Nikud are added to Hebrew writing system. Nikud are characters represent vowels.

So ISO 8859 Part 8 has no nikud in it but codepage 1255 has.

Inquisitor has no test such that.

t-sin commented 7 years ago

Added note in test code: https://github.com/t-sin/inquisitor/commit/479c9bbdbe015a879d9cea68cc89df98384844c9

t-sin commented 7 years ago

According to the book below, now nikud are not used in normallly. Of course two encoding schema has different with Nikud, It should be tested.

Note: Today it is not used but scripts showed below for vowels is developed and used in classic age. --- Hiroshi Shoji, Sekai no moji jiten [Encyclopedia of World Scripts], (Tokyo: Maruzen, 2015), 334