tests_gaudi: Added L2 vllm workload

intel / intel-technology-enabling-for-openshift

The project focuses on Intel’s enterprise AI and cloud native foundation for Red Hat OpenShift Container Platform (RHOCP) solution enablement and innovation including Intel data center hardware features, Intel technology enhanced AI platform and the referenced AI workloads provisioning for OpenShift.

https://intel.github.io/intel-technology-enabling-for-openshift/

Apache License 2.0

17 stars 12 forks source link

tests_gaudi: Added L2 vllm workload #329

Open vbedida79 opened 3 weeks ago

vbedida79 commented 3 weeks ago

PR includes gaudi l2 vllm workload

buildconfig based on https://github.com/opendatahub-io/vllm/blob/main-gaudi/Dockerfile.hpu.ubi
deployment including secret for hugging face token and pvc for model cache
Readme steps to build, deploy and verify

Signed-off-by: vbedida79 veenadhari.bedida@intel.com