triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend
Apache License 2.0
637 stars 92 forks source link

How to deploy qwen-vl using tensorrtllm_backend? #356

Open mouweng opened 5 months ago

mouweng commented 5 months ago

I would like to deploy qwen-vl using Triton. Do you have any example repositories that are compatible with qwen-vl?

chiquitita-101 commented 3 months ago

Same here. help!

JoursBleu commented 2 months ago

Same here. help!

Popsicle0-0 commented 3 weeks ago

Same here. help!