intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray
Apache License 2.0
103 stars 30 forks source link

Update VLLM installation script and documentation #212

Closed xwu99 closed 6 months ago

xwu99 commented 6 months ago

Signed-off-by: Wu, Xiaochang xiaochang.wu@intel.com