-
Hello,
The underlying package being used (https://github.com/dqbd/tiktoken) seems to run into issues in a Vercel Serverless environment. Our application currently is built on NextJS 13 and we are see…
vshei updated
9 months ago
-
Does anybody saw this behavior?
What could be the reason?
What are my alternatives?
I'm in western Europe and https://openai.com is available
![image](https://github.com/openai/tiktoken/assets…
-
在MacOS,用python调用qwen_cpp载入模型进行推理,只能启动CPU,无法使用GPU。
执行代码:
from qwen_cpp import Pipeline
model = "/Users/xxx/AIproject/qwen.cpp/qwen14b-ggml.bin"
tiktoken = "/Users/xxx/AIproject/models/Qwen/Qwen-1…
-
maybe port/compile tiktoken to js (via tiktoken-rs to wasm, or tiktoken-py with pyodide)
-
**The bug**
I'm trying to run llaam-2-7b-chat-hf with togtherAI client. But I'm getting following error from tokenizer.
```
Exception: The tokenizer provided to the engine follows a non-ChatML fo…
-
While installing using bun, getting the following error:
```
❯ bun i @anysphere/priompt
[0.04ms] ".env"
bun add v1.0.18 (36c316a2)
error: @anysphere/tikto…
-
There is no release for 3 months and just few commits recently, so will this project be actively maintained?
I tried serve using ray-llm with some LLM, and need to update transformers, install tikt…
-
When I run the demo code,I got the following error:
![image](https://github.com/refuel-ai/autolabel/assets/55434314/43607d91-3699-4407-99e6-b74bd35ac2db)
…
-
It seems there are multiple NPM packages associated with this `tiktoken` port, and I wasn't able to find the differences clearly documented anywhere. (`@dqbd/tiktoken`, `js-tiktoken`, and `tiktoken`).…
-
```
Successfully built goldenverba
Installing collected packages: asyncio, websockets, validators, typing-extensions, sniffio, regex, pyyaml, python-dotenv, pypdf, pycparser, multidict, httptools, h…