-
the newest version support Qwen2-VL? especially the mrope param need to be sent to LLM
-
### System Info
x86
Tensorrt_LLM 0.16.0
### Who can help?
_No response_
### Information
- [x] The official example scripts
- [ ] My own modified scripts
### Tasks
- [x] An officially supported …
-
-
### System Info
- `transformers` version: 4.47.0.dev0
- Platform: Linux-5.4.0-137-generic-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.26.2
- Safetensors version…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue y…
-
I tried generating .uqff quantized files for Qwen2-VL-2B-Instruct
`cargo run --features metal -release -- --model-id Qwen/Qwen2-VL-2B-Instruct --filename Qwen/Qwen2-VL-2B-Instruct-###.uqff`
Howe…
-
### System Info
2024-11-26T11:36:19.229621Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.80.1
Commit sha: d2ed52f531cf8098ca62375248e00702…
-
Anyone successful finetune Qwen2-VL-7B-Instruct. I finetuned with 2 card A00 and got error CUDA OOM. Can you share which resources recommend to finetune it?
Thank you!
-
### System Info
qwen2-vl added new features of M-ROPE, please support it
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Task…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
None
### Reproduction
lora qwen2-vl
### Expected behavior
Using Lora to train qwen2-vl, will the visu…