Add `gpt-4-1106-preview`

zurawiki / tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken

MIT License

240 stars 47 forks source link

Closed JosephTLyons closed 10 months ago

JosephTLyons commented 10 months ago

The preview of the gpt-4 turbo is out:

It would be great to have support for this model!

zurawiki commented 10 months ago

This is definitely something we want to support. I don't have time this weekend, but I'm open to reviewing a PR

JosephTLyons commented 10 months ago

Here's a PR I opened:

zurawiki commented 10 months ago

Merged! Thanks for your help @JosephTLyons