-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.8.4.dev0
- Platform: Linux-4.18.0-2.4.3.3.kwai.x86_64-x86_64-with-glibc2.29
…
-
报错信息如下：
File "/home/hibug/anaconda3/envs/shizhevl/lib/python3.10/site-packages/vllm/entrypoints/openai/api_server.py", line 132, in build_async_engine_client_from_engine_args
if (model_is_em…
-
out, q, k, v, out_padded, softmax_lse, S_dmask, rng_state = flash_attn_cuda.fwd(
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some ot…
-
I have tried to get several different models to generate captions, keywords, etc, for this image:
Some of the results are…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
LLaMA Factory, version 0.9.1.dev0
liger_kernel 0.3.0
transformers 4.45.0.dev0
### Reproduction
llamaf…
arit2 updated
2 months ago
-
modelscope.hub.errors.FileIntegrityError: File /home/apple/.cache/modelscope/hub/._____temp/qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4/model-00002-of-00002.safetensors integrity check failed, expected sha256…
-
你好！我的机器是h800，我按照repo中进行了如下按照步骤：
```
pip install git+https://github.com/huggingface/transformers@21fac7abba2a37fae86106f87fcf9974fd1e3830 accelerate
pip install qwen-vl-utils
CUDA_VERSION=cu123
pi…
-
使用examples/train_lora/qwen2vl_lora_sft.yaml脚本微调，一切正常。
将freeze_vision_tower设置为false后，运行脚本报错：ValueError: Target module Conv3d(3, 1280, kernel_size=(2, 14, 14), stride=(2, 14, 14), bias=False) is not su…
-
'{"object":"error","message":"Unknown part type: image","type":"BadRequestError","param":null,"code":400}'
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程，最好有截图)
命令：CUDA_VISIBLE_DEVICES=0 swift infer --model_type qwen2-vl-7b-instruct --infer_backend vllm -…