Priority

P3-Medium

OS type

Ubuntu

Hardware type

Xeon-ICX

Installation method

[ ] Pull docker images from hub.docker.com
[ ] Build docker images from source

Deploy method

[X] Docker compose
[ ] Docker
[ ] Kubernetes
[ ] Helm

Running nodes

Single Node

What's the version?

commit ID: 179fd843629952315e1968789f52764876e7f22d https://github.com/opea-project/GenAIExamples/tree/main/ChatQnA/docker_compose/intel/hpu/gaudi

Description

The system hits an error when running docker-compose
habana-container-runtime is already installed on the system
Docker daemon.json also points to the habana-container-runtime (see excerpt-1)
Error response below

docker compose up -d

[+] Running 0/4
 ⠋ Container tei-reranking-gaudi-server  Creating                                                                                                                                                        0.1s
 ⠋ Container tei-embedding-gaudi-server  Creating                                                                                                                                                        0.1s
 ⠋ Container tgi-gaudi-server            Creating                                                                                                                                                        0.1s
 ⠋ Container redis-vector-db             Creating                                                                                                                                                        0.1s
Error response from daemon: unknown or invalid runtime name: habana

Excerpt-1


cat /etc/docker/daemon.json
{
"default-runtime": "habana",
"runtimes": {
  "habana": {
     "path": "/usr/bin/habana-container-runtime",
     "runtimeArgs": []
  }
}
}


### Reproduce steps

Steps to reproduce can be found here: [Link](https://github.com/opea-project/GenAIExamples/tree/main/ChatQnA/docker_compose/intel/hpu/gaudi)

- export variables

export host_ip="External_Public_IP" export HUGGINGFACEHUB_API_TOKEN="Your_Huggingface_API_Token"

export http_proxy="Your_HTTP_Proxy" export https_proxy="Your_HTTPs_Proxy"

Example: no_proxy="localhost, 127.0.0.1, 192.168.1.1"

export no_proxy="Your_No_Proxy",chatqna-gaudi-ui-server,chatqna-gaudi-backend-server,dataprep-redis-service,tei-embedding-service,retriever,tei-reranking-service,tgi-service,vllm_service,guardrails


- source environment file

source ./set_env.sh


- Run docker compose

docker compose up -d


### Raw log

```shell
N/A

opea-project / GenAIExamples

[Bug] OPEA docker container and habana runtime issue #1164