search

dqbd / tiktoken

JS port and JS/WASM bindings for openai/tiktoken
MIT License
648 stars 49 forks source link

Add support for gpt-4-1106-preview #79

Closed pkallos closed 7 months ago

pkallos commented 8 months ago

Adding support for GPT4-turbo

Could use a bit of guidance on how to test/validate, reached some hurdles with the build.

wrangle 1.xx is deprecated which is causing issues.

pkallos commented 7 months ago

@dqbd did my best here, not sure how to handle wrangler since I have never used but build/test passes now

missuo commented 7 months ago

@dqbd seems to have been inactive for some time, and my project is now planning to support GPT-4 Turbo. I hope this PR can be merged as soon as possible.

danrasmuson commented 7 months ago

Yes. Agreed. This PR supports a lot of us

dqbd commented 7 months ago

Hello! Sorry for the delay, released a new version of js-tiktoken@1.0.7 and tiktoken@1.0.11 which both add support for newer GPT-4-turbo and GPT-3.5-models.

Thank you @pkallos for the contribution!

missuo commented 7 months ago

Hello! Sorry for the delay, released a new version of js-tiktoken@1.0.7 and tiktoken@1.0.11 which both add support for newer GPT-4-turbo and GPT-3.5-models.

Thank you @pkallos for the contribution!

Thanks!

pkallos commented 7 months ago

Hello! Sorry for the delay, released a new version of js-tiktoken@1.0.7 and tiktoken@1.0.11 which both add support for newer GPT-4-turbo and GPT-3.5-models.

Thank you @pkallos for the contribution!

Thanks!