search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.8k stars 803 forks source link

New followers for TikTok #113

Closed Rombusek closed 1 year ago