search

pkoukk / tiktoken-go

go version of tiktoken
MIT License
649 stars 71 forks source link

not support for gpt-3.5-turbo-16k-0613 #28

Closed mengmengmengqiang closed 1 year ago

mengmengmengqiang commented 1 year ago

tkm, err := tiktoken.EncodingForModel("gpt-3.5-turbo-16k-0613")

get err even loaded file from https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken

pkoukk commented 1 year ago

It works fine for me. Try run go get -u github.com/pkoukk/tiktoken-go to update your dependencies. If there are still errors, please provide me with more details about the errors.

zachsmith1 commented 1 year ago

This should satisfy the issue you are seeing: https://github.com/pkoukk/tiktoken-go/pull/32