-
**例行检查**
[//]: # (方框内删除已有的空格,填 x 号)
+ [x] 我已确认目前没有类似 issue
+ [x] 我已确认我已升级到最新版本
+ [x] 我已完整查看过项目 README,尤其是常见问题部分
+ [x] 我理解并愿意跟进此 issue,协助测试和提供反馈
+ [x] 我理解并认可上述内容,并理解项目维护者精力有限,**不遵循规则的 issue 可能…
-
There is no release for 3 months and just few commits recently, so will this project be actively maintained?
I tried serve using ray-llm with some LLM, and need to update transformers, install tikt…
-
I made a toy GPT2 tokenizer as a python rust extension. It seems to be slightly faster than tiktoken in my tests. It looks like https://github.com/openai/tiktoken/pull/31 may get most or all the way…
-
Currently we're using `tiktoken` to calculate token count (not changed from original implementation.) It seems it's already providing a good estimation but ideally we should use this. https://github.c…
-
Is it possible to add support for the latest Embeddings models from Open AI: `text-embedding-3-large` and `text-embedding-3-small`?
-
[nuxt] [request error] [unhandled] [500] Cannot find module './dist/tiktoken-node.linux-x64-gnu.node'
Require stack:
- /var/task/node_modules/tiktoken-node/index.mjs
at Module._resolveFilename (n…
-
LMQL looks very promising (having played w/ Guidance) so I want to make this work but having issues from get go, trying to run it locally. I'm really hoping I can get some help.
IMMEDIATE GOAL: wha…
-
I just noticed that this package is around 13MB when unpackaged and I reached my AWS Lambda package size limit. This is absolutely too big for serverless deployment.
So my questions are:
- Why are…
-
I successfully installed it from source, but I don't know how to use the `chat` and `stream_chat ` interfaces, or how to load the model, etc. Are there any documents that I can refer to?
-
Hello,
Trying to run tiktokenizer from the app folder and I'm getting the following error:
```
Error: Element type is invalid. Received a promise that resolves to: [object Promise]. Lazy elemen…