-
https://docs.habana.ai/en/latest/PyTorch/DeepSpeed/DeepSpeed_User_Guide/DeepSpeed_User_Guide.html
-
Habana drivers expose several sysfs attributes through the _accel_ class: https://www.kernel.org/doc/html/latest/admin-guide/abi-testing.html#abi-file-testing-sysfs-driver-habanalabs
Habana drivers…
-
### Priority
Undecided
### OS type
Ubuntu
### Hardware type
Gaudi2
### Installation method
- [X] Pull docker images from hub.docker.com
- [ ] Build docker images from source
### Deploy method
…
-
### Priority
Undecided
### OS type
Ubuntu
### Hardware type
Gaudi2
### Installation method
- [X] Pull docker images from hub.docker.com
- [ ] Build docker images from source
### Deploy method
…
-
Using the v0.8 version of [ChatQnA example](https://github.com/opea-project/GenAIExamples/blob/v0.8/ChatQnA/docker/gaudi/compose.yaml), the tgi service fails with heath test.
Environment:
- OS: ub…
-
### Priority
Undecided
### OS type
Ubuntu
### Hardware type
Gaudi2
### Installation method
- [ ] Pull docker images from hub.docker.com
- [ ] Build docker images from source
### Deploy method
…
-
### System Info
```shell
I was reading that Gaudi supports Llama 3.1 -- https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-meta-llama-3-1-launch.html
A…
-
## GenAIExample FaqGen compose.yaml got changed
Below files are changed in [this commit](https://github.com/opea-project/GenAIExamples/commit/80e3e2a2d3120c7761a42991b7742c2085a295bd)
- FaqGen/d…
-
### System Info
```shell
HL-SMI Version: hl-1.17.0-fw-51.3.0
Driver Version: 1.17.0-28a11ca
Docker image: vault.habana.ai/gaudi-docker/1.17.0/ubuntu22.04/habanalabs/pytorch-installer-2.3.…
-
Model: [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
Deployed with single card, it will report OOM error:
> (ServeController pid=207518) F…