-
### Problem Description
Hi,
#654 tried to enable GPTQ quantization with fine-tuned LLaMA2 models, but was closed.
I tried following a similar approach as that PR, but for fine-tuned LLaMA3 mode…
-
### Describe the bug
When attempting to run "interpreter --local" and choosing jan.ai as the llm provider, the model choice function crashes interpreter.
LM_Studio runs as expected. (I'm assumi…
-
我运行 `python app.py` with error
Device: MacOS
Python version:3.10
报错显示 connect 失败了,但是我翻墙了也不行
`cat app.py`
```
# 修改成自己的配置!!!
app_config = ApplicationConfig()
app_config.docs_path = "./data/do…
-
### Describe the bug
running devika with docker , cant create a project or select a model
### How To Reproduce
Steps to reproduce the behavior (example):
1. clone the repo
2. rename sample…
-
好像没有这2个东西吧?
我直接
` python .\app.py`
报错:
```
Traceback (most recent call last):
File ".\app.py", line 13, in
from chat_reviewer import ReviewerParams, chat_reviewer_main
ImportError: …
-
How do you calculate token count for a python dict?
![image](https://github.com/openai/openai-cookbook/assets/2786295/2dc2632f-e8aa-4d51-ad11-5a5f7f84ce54)
I'm coming from https://github.com/ope…
-
**current status**: CI use tokenizer from "./test/assets/test_tiktoken.model", and has vacab size = 2256. FP8 GEMM requires matrix size to be divisible by 16. without any sharding, we have shape 2256 …
-
It seems that decord is causing issues with completing installation. How can I rectify this?
When I try to run:
pip install -e ".[train]"
I get the following:
Obtaining file:///Users/bill/Doc…
-
For different models, there are different token limitations.
For token user input should be less than half of the max token.
Refer `tokenUtils.js`
For nextjs it seems there are some features al…
-
Was trying to upload the project in Google Cloud run..using python 3.11.5
Not able to build wheels for Tiktoken..Tried every version. Can anybody help.
"Building wheel for tiktoken (pyproject.toml…