vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://docs.vllm.ai
Apache License 2.0
27.81k stars 4.11k forks source link

Create CI jobs for Power(ppc64le) #6095

Open DiptiKri02 opened 3 months ago

DiptiKri02 commented 3 months ago

🚀 The feature, motivation and pitch

Hi team, I am from the IBM Power porting team and have been assigned the task to create the required CI jobs for Power(ppc64le), as this PR has been merged: https://github.com/vllm-project/vllm/pull/5652

I have looked at the existing jobs, but its not very clear which jobs will have to be added for Power. Can you help me there?

Thanks.

Alternatives

No response

Additional context

No response

simon-mo commented 3 months ago

Hi! Please connect with me (email in profile) and @njhill (IBM Research) with your IBM email so we can discuss the level of CI and how to add it. (cc @khluu).