-
## **Describe the bug (required)** / **详细描述 bug(必填)**
A clear and concise description of what the bug is. / 请提供清晰且精确的 bug 描述
---
## **To Reproduce (required)** / **如何复现 bug?(必填,非常重要)**
Ste…
-
I followed the Quickstart tutorial and deployed the Chinese-llama-alpaca-2 model using vllm, and I got the following error.
`***@***:~/Code/experiment/***/ToG$ CUDA_VISIBLE_DEVICES=0 python load_llm.…
-
On running:
`python load_videos.py --metadata ../data/ted384-metadata.csv --format .mp4 --out_folder ../data/TED384-v2 --workers 8 --image_shape 384,384`
I get:
> Traceback (most recent call la…
-
**Describe the bug**
Unable to conversion to onnx and latency optimization.
KeyError: 'unet_dataloader' occurs when optimizing unet in stable_diffusion_xl.py.
**To Reproduce**
- Pre-work (https:…
-
* SQLAlchemy Easy Soft-Delete version: 0.8.3
* Python version: 3.12
* Operating System: Ubuntu 22
### Description
I have a [Litestar](https://github.com/litestar-org/litestar) Application whic…
-
Platforms: linux, slow
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_load_from_view_buffer&suite=TestFlexAttention&limit=100) a…
-
用 vllm 部署 Qwen2-VL-7B-Instruct,启用 prefix-caching 推理图像数据时报错 shape mismatch,prefix-caching + 纯文本数据不会报错,关闭 prefix-caching + 图像数据也不会报错
报错:
File "/opt/miniforge3/envs/vllm-qwen2-vl/lib/python3.10/site-…
-
for train_index, test_index in kfold.split(B, y1):
print('train_index',train_index)
print('test_index',test_index)
train_index, val_index = train_test_split(
train_index, tes…
-
拉取这个分支的VLLM: https://github.com/fyabc/vllm/tree/add_qwen2_vl_new
环境:Ubuntu + python 3.10
报错信息:
python -m vllm.entrypoints.openai.api_server --served-model-name Qwen2-VL-7B-Instruct --model /home/…
-
### The problem
I have a Xiaomi BLE plant sensor . I had it working then this week some entities became unavailable, temp still works but no moisute fertility or lux. All these sensors are still broa…