-
Hi, I tried using Ray-serve to deploy llama3 and phi3 models, but it seems that there are still some issues.
## 1. Rayserve doesn't support multiple cards now
LLama2-70b or Llama3-70b can't run o…
-
Colossal-AI may be used to reduce GPU Memory consumption during training (but may cause more training time).
https://github.com/hpcaitech/ColossalAI
Colossal-AI is used for acceleration of AIGC (A…
-
This requirement is HuggingFace Accelerate to support the Gaudi architecture, a high-performance AI accelerator developed by Habana Labs.
-
Hi,
would it be possible to add --prefix to the build script?
Should set -DCMAKE_INSTALL_PREFIX option. Makes it easier for nonstandard installs, e.g. module environment.
e.g.
```
# S…
-
Currently, Image Classification/LARS/Pytorch combination lists no compliant optimizers.
However, 2.2 submission by Habana used what looks like FusedLars optimizer (their own implementation) for Py…
-
### 😵 Describe the installation problem
I recently gained access to an [amazon EC2 DL1 instance](https://aws.amazon.com/ec2/instance-types/dl1/) which use [Gaudi accelerators](https://habana.ai/train…
-
### Feature request
is stabilityai/stable-diffusion-3-medium-diffusers model supported on Gaudi, I tried to run the model , Iam getting the below error ...
Traceback (most recent call last):
Fi…
-
Hello there, I am new to Gaudi devices, I have been trying the toy sample in the repo on AWS DL1. I attempted to map the follow script
```https://github.com/HabanaAI/Model-References/tree/master/PyTo…
-
Instituto de investigación
-
### Description
The example pages under each library may contain examples contributed by the Ray Community. We want to demarcate them clearly so that readers understand they are not maintained by the…