Better unicode.ml generator

ocaml-community / sedlex

An OCaml lexer generator for Unicode

MIT License

239 stars 43 forks source link

Better unicode.ml generator #141

Closed hhugo closed 1 year ago

hhugo commented 1 year ago

no longer extract information from comments
extract missing information from UnicodeData.txt
track ignored properties so that one can codereview them
make the parsing of Unicode data fail if lines don't have the expected format.

Based on #144

hhugo commented 1 year ago

I've extracted some fix in #144

hhugo commented 1 year ago

This is now based on top of #144. Only the last commit is part of this PR. once #144 is merged, this PR will only change how unicode.ml is generated but will no change its content.

hhugo commented 1 year ago

I've rebased this PR. ready for another round of review