Install Sacremoses tokenizer in the SLC

exasol / transformers-extension

An Exasol extension for using state-of-the-art pretrained machine learning models via the Hugging Face Transformers API.

MIT License

2 stars 2 forks source link

Closed ahsimb closed 9 months ago

ahsimb commented 1 year ago

Some models require the Sacremoses tokenizer to be installed in order to get downloaded.