Redefine Embeddings Based on Subword Probabilities

[koaning]

It might make sense to allow for something like; https://www.aclweb.org/anthology/2020.findings-emnlp.53.pdf

[koaning]

Only tokenize the sub tokens according to this scheme;