Feature/add custom tokenizer

heiglandreas / Org_Heigl_Hyphenator

Provide TeX-Hyphenation to PHP

http://orgheiglhyphenator.readthedocs.org

MIT License

54 stars 14 forks source link

Feature/add custom tokenizer #33

Closed heiglandreas closed 7 years ago

heiglandreas commented 7 years ago

Allows one to add a tokenizer that will respect words that are

either marked to be not hyphenated at all (prepend NoHyphenateString)
or already contain a (one!) custom hyphenation mark (CustomHyphen somewhere within the word)

The NoHyphenateString and the CustomHyphen can be set via the Options.

coveralls commented 7 years ago

Coverage decreased (-1.3%) to 97.889% when pulling 39977c92b73982bc2b4cc1183703cc6f90ef89d4 on feature/addCustomTokenizer into 9a8ac28f654e1ec0779caaffe57edcd2575973f6 on master.