search

opea-project / GenAIComps

GenAI components at micro-service level; GenAI service composer to create mega-service
Apache License 2.0
51 stars 110 forks source link

LLM on Gaudi by vLLM + Ray #257

Closed kevinintel closed 2 months ago

kevinintel commented 3 months ago

LLM on Gaudi by vLLM + Ray