search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
12.52k stars 856 forks source link

U #325

Closed elnryv closed 4 months ago

elnryv commented 4 months ago

E