-
Colossal-AI may be used to reduce GPU Memory consumption during training (but may cause more training time).
https://github.com/hpcaitech/ColossalAI
Colossal-AI is used for acceleration of AIGC (A…
-
This requirement is HuggingFace Accelerate to support the Gaudi architecture, a high-performance AI accelerator developed by Habana Labs.
-
I ran the infernce of Falcon-7b and neural-chat-7b-v3-1 models on ray server with below command
python inference/serve.py --config_file inference/models/neural-chat-7b-v3-1.yaml --simple
python infe…
-
Hi,
would it be possible to add --prefix to the build script?
Should set -DCMAKE_INSTALL_PREFIX option. Makes it easier for nonstandard installs, e.g. module environment.
e.g.
```
# S…
-
### 😵 Describe the installation problem
I recently gained access to an [amazon EC2 DL1 instance](https://aws.amazon.com/ec2/instance-types/dl1/) which use [Gaudi accelerators](https://habana.ai/train…
-
Currently, Image Classification/LARS/Pytorch combination lists no compliant optimizers.
However, 2.2 submission by Habana used what looks like FusedLars optimizer (their own implementation) for Py…
-
### System Info
```shell
optimum-habana==1.10.4
docker: vault.habana.ai/gaudi-docker/1.14.0/ubuntu22.04/habanalabs/pytorch-installer-2.1.1:latest
```
### Information
- [ ] The official example sc…
-
Nvidia AI cards (Tesla, A100, A40, A2) are not detected as GPU elements. The reason is that these controllers are 3D controller devices (`0x0302`) and don't have DRM interface.
For example:
```
$…
-
### Your current environment
PyTorch version: 2.3.1a0+git4989238
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC vers…
-
Hello there, I am new to Gaudi devices, I have been trying the toy sample in the repo on AWS DL1. I attempted to map the follow script
```https://github.com/HabanaAI/Model-References/tree/master/PyTo…