Decide on Unicode normalization - Githubissues

gbv / jskos-api

HTTP-JSON-API to query SKOS based on JSKOS

https://gbv.github.io/jskos-api/

Creative Commons Zero v1.0 Universal

0 stars 0 forks source link

Decide on Unicode normalization #7

Open nichtich opened 9 years ago

nichtich commented 9 years ago

Basic support of Unicode normalization should be mandatory but to what degree and how about extended normalizations (e.g. removal of diacritics and punctation).

nichtich commented 8 years ago

JSKOS 0.13 requires NFC. The better question is what kinds of folding to support:

case folding
accent-folding (or accent + case)
NFKC/NFKD can also be seen as folding
other foldings (e.g. chinese traditional to simplified)...

One fold parameter may be enough with a list of supported combinations in service description:

{  "fold": [ "accent","accent,case", "nfk", "foobar" ] }

The folding names "accent", "case", and "nfk" will be defined by JSKOS-API spec. Other foldings MAY be supported or ignored.

See also #11 for support of regular expression search.