-
```
Error occurred when executing Joy_caption:
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model o…
DrJKL updated
12 hours ago
-
- 环境
- docker: registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:0.1.13_cuda12
- cuda: 12.1
- driver: 515.105.01
- 模型:
- llama: https://huggingface.co/lmsys/vicuna-33b-v1.3
…
-
### Python -VV
```shell
Python 3.10.12 (main, Mar 22 2024, 16:50:05) [GCC 11.4.0]
```
### Pip Freeze
```shell
absl-py==1.4.0
accelerate==0.32.1
aiohttp==3.9.5
aiosignal==1.3.1
alabaster==0.7.1…
-
Run [convert.py](https://github.com/openvinotoolkit/openvino.genai/blob/master/llm_bench/python/convert.py) on Meta-Llama-3.1-8B-Instruct model, Error occur as below:
> ValueError: `rope_scaling` mus…
-
Hi I downloaded 3 models from civitai, and none of them work, I don't know what am I doing wrong
Specs: M1 macbook air
Sonoma 14.5
Xcode 15.4
```
Starting python converter
scikit-learn ver…
-
### Feature request
It's a common practice to place the `conftest.py` file within the `tests/` directory.
### Your contribution
Initial Attempt: https://github.com/huggingface/transformers/…
-
When attempting to manually deploy the model to sagemaker via a deployment script or automatically deploying the model via the huggingface inference endpoints UI, I receive the same error:
"ValueEr…
-
Hi,
Could you give me some insights whether is possible to plug in inltk with huggingface transformer library
-
Package like the following is not install
- diffusers
- ultralytics
- segment_anything
Turns out it is because launch is not available and unable to `pip install launch`.
Have to change to usin…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
我的代码如下:
from llama_index.core import KnowledgeGraphIndex,SimpleDirectoryReader,Settings…