Open ggbetz opened 5 months ago
add --pipeline-parallel-size for vllm, to efficiently use multi-gpu resources
add --pipeline-parallel-size for vllm, to efficiently use multi-gpu resources