dqbd / tiktoken

JS port and JS/WASM bindings for openai/tiktoken
MIT License
648 stars 49 forks source link

Add support for GPT-4-O, "Omni" model #104

Closed pkallos closed 1 month ago

pkallos commented 1 month ago

@dqbd seems the encoding model has changed, need to build/test support with o200k_base

pkallos commented 1 month ago

OK, I have made the following changes in order to support the new encoding model:

This has been tested as follows:

  1. build the project with turbo build
  2. run the tests with turbo test
Pckool commented 1 month ago

Please merge this asap @dqbd 🙏 breaks gpt4o support on langchain

dqbd commented 1 month ago

Thank you so much @pkallos!

gonzalonunez commented 1 month ago

Amazing! Can we draft a new release?

elliotmassen commented 1 month ago

Hey @dqbd, do you know when version 1.0.15 might be published to NPM?