-
I went through the habana code inside this repo and how Intel uses a cheatcode method to adapt any transformer modules to run on Intel gaudi/gaudi2 hardware. I didn't read the underlying code written …
-
-
### Model description
https://github.com/huggingface/text-generation-inference/pull/1709
Since the TGI has done the LlaVa support. Would like to know if there is any timeline for the LlaVa support o…
-
Whisper web takes 2 seconds to transcribe one second of audio in my browser.
ASR in habana takes 2 seconds to transcribe one second of audio through the API.
Can we change or optimize the whispe…
-
InstructLab 0.13 supports hardware acceleration for Apple Silicon (via `mlx`) and CUDA-like GPUs (NVIDIA CUDA and AMD ROCm via `torch.cuda`). I would like to add support for Intel Gaudi 2 hardware and…
tiran updated
1 month ago
-
### System Info
```shell
optimum-habana v1.11.0.dev0
deepspeed v1.11.0
vault.habana.ai/gaudi-docker/1.14.0/ubuntu22.04/habanalabs/pytorch-installer-2.1.1:latest
| HL-SMI Version: …
-
Hi! I'm Yasuna🤗
Let's bring the documentation to all the Japanese-speaking community 🌐.
Who would want to translate? Please follow the 🤗 [TRANSLATING guide](https://github.com/huggingface/di…
-
### System Info
```shell
optimum-habana==1.11.1
Gaudi 2 on Intel Developer Cloud
image: vault.habana.ai/gaudi-docker/1.15.1/ubuntu22.04/habanalabs/pytorch-installer-2.2.0:latest
```
### Informati…
-
### System Info
```shell
Optimum-habana main branch, at the commit 8863f1cc2be695a59673fc8a8095e25101a45f3f
SW hl-1.15.0
```
### Information
- [ ] The official example scripts
- [X] My own modifi…
-
Using the image **opea/tei-gaudi:v0.7** on a gaudi-enabled k8s cluster doesn't work. When launch the pod, it will fail with the following error message during start up:
```
Traceback (most recent …