search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.76k stars 801 forks source link

ValueError: Unknown encoding cl100k_base #142

Closed nnnnnb closed 1 year ago

nnnnnb commented 1 year ago

ValueError: Unknown encoding cl100k_base ENCODING_CONSTRUCTORS：{}

hauntsaninja commented 1 year ago

Please provide a way to reproduce the problem. If you're using pyinstaller, see the FAQ: https://github.com/openai/tiktoken/issues/98