-
**Describe the bug**
**问题描述**
Getting the error "Buffer is not defined" when trying to use ChatGPT Web. Looks related to https://github.com/josStorer/chatGPTBox/commit/77a14e23ef47dbbcf3419350db10ce…
-
Thank you for the amazing work. I'm currently using Langchain's `RecursiveCharacterTextSplitter` to generate chunks for completion. It is currently the bottleneck of my application, so I've been looki…
-
## 🐍 Package Request
- tiktoken 0.5.1
- https://github.com/openai/tiktoken/
- Package Dependencies that needs to be resolved first:
```
dependencies = ["regex>=2022.1.18", "requests>=2.26.0"]
…
-
This is a duplicate of https://github.com/dqbd/tiktoken/issues/46 but that's closed, and I don't think it should be 😄
Following the instructions here in the README:
https://github.com/dqbd/tikt…
-
The implementation at https://github.com/openai/tiktoken/commits/main/src/lib.rs has seen several improvements in the last year (eg https://github.com/openai/tiktoken/pull/255), including a couple tha…
-
### Bug Description
from llama_index.core import (
SQLDatabase,
VectorStoreIndex,
Settings,
)
from llama_index.llms.openai import OpenAI
from llama_index.core.query_engine import NL…
-
How do you calculate token count for a python dict?
![image](https://github.com/openai/openai-cookbook/assets/2786295/2dc2632f-e8aa-4d51-ad11-5a5f7f84ce54)
I'm coming from https://github.com/ope…
-
I am getting `WARNING:root:Warning: model not found. Using cl100k_base encoding.` when using non openAI models such as claude-2. I checked the code and it seems to be a tiktoken issue.
Am I getting…
-
Hello, good morning,
I have downloaded the repository to experiment with the VSCode extension, but when trying to run it in development mode, I get the following error:
Activating extension 'tim…
-
Hello!
I noticed that one of the methods for the providers is `llm-count-tokens` which currently does a simple heuristic. I recently wrote a [port of tiktoken](https://github.com/zkry/tiktoken.el)…
zkry updated
6 months ago