-
The container file https://github.com/containers/ai-lab-recipes/blob/main/training/intel-bootc/Containerfile does not contain necessary bits and pieces to setup InfiniBand Intel Gaudi devices. Without…
tiran updated
2 months ago
-
T2V is planned to enable inferencing LLMs like Stable Diffusion on CPU/GPU, and training on Habana Gaudi/DG2, as well as improving the Generated Video quality, like more realistic frame, and coherency…
-
### 😵 Describe the installation problem
I recently gained access to an [amazon EC2 DL1 instance](https://aws.amazon.com/ec2/instance-types/dl1/) which use [Gaudi accelerators](https://habana.ai/train…
-
Colossal-AI may be used to reduce GPU Memory consumption during training (but may cause more training time).
https://github.com/hpcaitech/ColossalAI
Colossal-AI is used for acceleration of AIGC (A…
-
### System Info
```shell
HL-SMI Version: hl-1.17.0-fw-51.3.0
Driver Version: 1.17.0-28a11ca
Docker image: vault.habana.ai/gaudi-docker/1.17.0/ubuntu22.04/habanalabs/pytorch-installer-2.3.…
-
This requirement is HuggingFace Accelerate to support the Gaudi architecture, a high-performance AI accelerator developed by Habana Labs.
-
### Description
The example pages under each library may contain examples contributed by the Ray Community. We want to demarcate them clearly so that readers understand they are not maintained by the…
-
llama 3.1 breaks on vllm with the error on --rope-scaling. The dockerfile.cpu needs to be updated to use the new IPEX patch and upgraded transformers if necessary.
[https://github.com/vllm-project/v…
-
### System Info
tgi-gaudi docker container built from master branch (4fe871ffaaa62f1a203607078e868fcca962b017)
Ubuntu 22.04.3 LTS
Gaudi2
HL-SMI Version: hl-1.15.0-fw-48.2.1.1
Driver Version: 1…
-
### System Info
```shell
optimum-habana 1.8.0
docker vault.habana.ai/gaudi-docker/1.12.0/ubuntu22.04/habanalabs/pytorch-installer-2.0.1:latest
Synapse Version 1.12.0-480
https://github…