search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
12.52k stars 856 forks source link

Is the model link invalid？ #233

Closed igorwang closed 10 months ago

igorwang commented 11 months ago

https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken

image image

tiktoken==0.5.2