search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
12.29k stars 831 forks source link

Do you have a Java version of tiktoken #156

Closed gitcyh closed 1 year ago

gitcyh commented 1 year ago

Do you have a Java version of tiktoken

hauntsaninja commented 1 year ago

See the FAQ