Fix blobfile dependency

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

MIT License

12.52k stars 856 forks source link

Fix blobfile dependency #208

Closed Praful932 closed 1 year ago

Praful932 commented 1 year ago

Fixes #209

tiktoken.encoding_for_model("gpt-3.5-turbo") - ValueError: Unknown encoding cl100k_base
tiktoken.encoding_for_model("gpt-3.5-turbo-0613") - 'ABCMeta' object is not subscriptable

hauntsaninja commented 1 year ago

Thanks! Closing as per comment on the issue