Make tgi-gaudi compatible with driver versions

opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

https://opea.dev

Apache License 2.0

176 stars 86 forks source link

Make tgi-gaudi compatible with driver versions #366

Open chensuyue opened 1 week ago

lkk12014402 commented 5 days ago

description:

1.15.x docker can't run on 1.16.x driver

solution

reset container driver not work

https://docs.habana.ai/en/latest/Orchestration/OpenShift_User_Guide/Load_habanalabs_Driver.html

can't install the Intel Gaudi Software Stack in the container successfully
copy the Intel Gaudi Software Stack to host, not friendly

give explanations at document

re-build docker image using the habana base image adapted to the driver version
re-install driver