search

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
MIT License
11.76k stars 801 forks source link

Get_encoding failures in aws lambda execution #119

Closed jhb96 closed 1 year ago

jhb96 commented 1 year ago

Trying execute a lambda with tiktoken (0.0.3) makes timeouts when it tries to get_encoding. I though the cause was the threading in registry.py (_lock = threading.RLock()) but i tried to make threading in lambda and it worked for me. I will continue looking for the problem...

hauntsaninja commented 1 year ago

Thanks, closing since there isn't a reproducible issue here