Add hookset and support for overriding tokenizer via get_prepared_tokens

scaife-viewer / beyond-translation-site

Site used to iterate on translation alignments within the Scaife Viewer ecosystem

3 stars 4 forks source link

Closed jacobwegner closed 11 months ago