openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.61k stars 785 forks source link

For Android #173

Closed leotorenzo6 closed 1 year ago

leotorenzo6 commented 1 year ago

Can't used or not?

hauntsaninja commented 1 year ago

There's not enough information in this question for me to understand what you're asking.