exasol / transformers-extension

An Exasol extension for using state-of-the-art pretrained machine learning models via the Hugging Face Transformers API.
MIT License
2 stars 2 forks source link

Add sentencepiece package to the dependencies #227

Open tkilias opened 1 month ago

tkilias commented 1 month ago

Many model need the sentencepiece tokenizer, for that reason, we should add it to the dependencies.