huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
https://huggingface.co/docs/tokenizers
Apache License 2.0
8.92k stars 777 forks source link

tokenizers-linux-x64-musl is not found when running inside node apline docker #1480

Closed madhurjya-acko closed 4 months ago

madhurjya-acko commented 6 months ago

Whenever trying to use inside a docker container with node alpine (it uses musl instead of glibc) tokenizers-linux-x64-musl is not present while importing tokenizers

github-actions[bot] commented 5 months ago

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

ArthurZucker commented 3 months ago

HEy this is most probably related to the version of python that you are using