dqbd / tiktoken

JS port and JS/WASM bindings for openai/tiktoken
MIT License
705 stars 53 forks source link

feat: Add missing models #53

Closed kdwkr closed 1 year ago

kdwkr commented 1 year ago

Add missing models and types for WASM.

kdwkr commented 1 year ago

@dqbd Could you review and merge this PR?

kiejo commented 1 year ago

It looks like a similar pull request (https://github.com/dqbd/tiktoken/pull/51) has already been merged, but it hasn't been released as a new version yet.

kdwkr commented 1 year ago

@kiejo The pull request has a few omissions. So I created this pull request for add some missed types and model. And alreay the version that applied the pull request released. https://www.npmjs.com/package/tiktoken

kiejo commented 1 year ago

Oh that's good to know and could explain why I got an Invalid model: gpt-3.5-turbo-0613 error when trying the newest version (1.0.8). It sounds like your pull request might fix that!

dqbd commented 1 year ago

lgtm! thanks for the fix

dqbd commented 1 year ago

Should be now released as 1.0.9