Classify fishtail and tilde as punctuation in tokenizing

homermultitext / hmt-textmodel

Model of text content of HMT editions

1 stars 1 forks source link

Classify fishtail and tilde as punctuation in tokenizing #73

Closed neelsmith closed 4 years ago

neelsmith commented 4 years ago

Can't pass this along to LGS function -- need to refactor for punctuation definition for scholia as validCP method uses scholia definition of valid alphabetString

neelsmith commented 4 years ago

implemented and tested