search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.17k stars 751 forks source link

Use a fresh tempdir for data-gym-cache to avoid "Permission denied" #219

Closed wookayin closed 7 months ago

wookayin commented 7 months ago

See https://github.com/openai/tiktoken/issues/75#issuecomment-1810255745. (Fixes #75)

wookayin commented 7 months ago

9e79899bc248d5313c7dd73562b5e211d728723d

But unfortunately the same permission denied will happen in the #75's scneario, if cache_dir is owned by someone else.