Fix data directory for test

huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

https://huggingface.co/docs/tokenizers

Apache License 2.0

8.68k stars 745 forks source link

Fix data directory for test #1488

Closed atupone closed 1 month ago

atupone commented 2 months ago

python binding test fails (to me) due to a wrong path of the data directory. Both works: either this commit, or a symbolic link of the data directory at the same level of tests