Implement the stanza processing as a custom registered tokenizer spacy_stanza.PipelineAsTokenizer.v1
Include all stanza.Pipeline settings in the tokenizer config block
Move the custom user hooks into the tokenizer processing
Add the helper method spacy_stanza.blank() for pipeline initialization, which sets up the custom tokenizer in the config and passes the config on to spacy.blank()
Implement the stanza processing as a custom registered tokenizer
spacy_stanza.PipelineAsTokenizer.v1stanza.Pipelinesettings in the tokenizer config blockAdd the helper method
spacy_stanza.blank()for pipeline initialization, which sets up the custom tokenizer in the config and passes the config on tospacy.blank()Update README