Open jcxcer opened 3 months ago
The output of `python collect_env.py`
I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.
vllm==0.3.3
refer to:https://github.com/vllm-project/vllm/issues/3543
Your current environment
How would you like to use vllm
I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.