search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.16k stars 751 forks source link

Is the model link invalid？ #233

Closed igorwang closed 6 months ago

igorwang commented 6 months ago

https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken

image image

tiktoken==0.5.2