search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
12.27k stars 830 forks source link

The walrus operator prevents the package from working for Python 3.7. #129

Closed LuisGarciaGomez closed 1 year ago

LuisGarciaGomez commented 1 year ago

https://github.com/openai/tiktoken/blob/095924e02c85617df6889698d94515f91666c7ea/tiktoken/core.py#L116

hauntsaninja commented 1 year ago

Duplicate of https://github.com/openai/tiktoken/issues/35