tiktoken_ext.__pycache__ Issue On Amazone Lambda

openai / tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

MIT License

11.98k stars 816 forks source link

tiktoken_ext.pycache Issue On Amazone Lambda #169

Open FarzamHejaziK opened 1 year ago

FarzamHejaziK commented 1 year ago

While EC2 is ok. On Amazon Lambda I get this error: Traceback (most recent call last): File "/var/task/tiktoken/registry.py", line 34, in _find_constructors constructors = mod.ENCODING_CONSTRUCTORS AttributeError: module 'tiktoken_ext.pycache' has no attribute 'ENCODING_CONSTRUCTORS'

Pyhton 3.9. Packaged with Zappa.

dheerajiiitv commented 1 year ago

raised a PR here https://github.com/openai/tiktoken/pull/152

openai / tiktoken

tiktoken_ext.__pycache__ Issue On Amazone Lambda #169

tiktoken_ext.pycache Issue On Amazone Lambda #169