Fix blobfile dependency

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

MIT License

11.17k stars 751 forks source link

Fix blobfile dependency #208

Closed Praful932 closed 8 months ago

Praful932 commented 9 months ago

Fixes #209

tiktoken.encoding_for_model("gpt-3.5-turbo") - ValueError: Unknown encoding cl100k_base
tiktoken.encoding_for_model("gpt-3.5-turbo-0613") - 'ABCMeta' object is not subscriptable

hauntsaninja commented 8 months ago

Thanks! Closing as per comment on the issue