First thanks for this awesome work and making it open source! I have been using the tokenizer (inference) for my experiments. It would be really great if this repo was a package so we could load the model easily after a pip install without having to checkout the code.
First thanks for this awesome work and making it open source! I have been using the tokenizer (inference) for my experiments. It would be really great if this repo was a package so we could load the model easily after a pip install without having to checkout the code.