search

mvitlov / tiktoken

tiktoken is a BPE tokeniser for use with OpenAI's models
Other
23 stars 7 forks source link

Are there plans to support GPT-4 in the future? #2

Closed ZingerLittleBee closed 1 year ago

ZingerLittleBee commented 1 year ago

I quickly looked through the code and did not find any mention of the GPT-4 model. Please correct me if I missed anything. Thank you for your time.

mvitlov commented 1 year ago

I've added the support for GPT-4.

The new version 1.0.2 is pushed to pub.dev also.