Factor out archive reading and tokenization

homermultitext / hmt-textmodel

Model of text content of HMT editions

1 stars 1 forks source link

Closed neelsmith closed 5 years ago

neelsmith commented 5 years ago

Same tokenization should be applicable to all generated editions.

Reading task should be implemented via MidReader trait.

Tokenization shoudl be implemented via MidOrtrhography trait.

neelsmith commented 5 years ago

done and tested