openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.06k stars 749 forks source link

Support for GPT 4o #305

Closed jcrupi closed 3 weeks ago

jcrupi commented 4 weeks ago

Wondering when GPT 4o support will be added.

hauntsaninja commented 3 weeks ago

It was added in v0.7 with the o200k_base encoding