-
**Issue**
I ran `encoding = tiktoken.get_encoding("cl100k_base")` and encountered the following error:
`SSLError: HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retrie…
-
### What happened?
litellm writes to the filesystem during initialization. I'm building a macOS application and this causes a read-only filesystem error:
> Failed to execute script 'main' due to…
-
I am using tiktoken in my project but when I deployed my project into AWS lambda I got the below error.
Unknown encoding cl100k_base. Plugins found: ['tiktoken_ext.__pycache__', 'tiktoken_ext.openai_…
-
TikToken was working fine encoding and decoding tokens for me then without any changes (just demoing what was working before) it failed with this error:
```
Unhandled Runtime Error
Error: null po…
-
Hello,
I'm trying to create a custom tokenizer but am getting "pyo3_runtime.PanicException: no entry found for key" despite being sure of coverage. This seems to happen when a character that requir…
-
I'm using the sample code for Cloudflare Workers and got these errors in VS Code:
```
Cannot find module 'tiktoken/lite/init' or its corresponding type declarations.
Cannot find module './node_mo…
-
Support o200k_base for gpt4o
-
When I use a Chinese prompt to call GPT-4, the actual number of tokens used by the model is less than that of GPT-4 Turbo, which is expected. But how can I calculate the actual number of tokens co…
-
Raising the visibility of https://github.com/IAPark/tiktoken_ruby/pull/21#issuecomment-1938163912
Anyone have bandwidth to help maintain this?
There's some low hanging fruit for https://github.c…
-
Thanks for maintaining this excellent repository! I found a minor issue with the requirements.txt file that might cause conflicts for users with newer versions of Langchain. I'd be happy to submit a p…