-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
seq_group_metadata_list.extend(
self.create_dummy_seq_group_metadata(0, 0, is_prompt)
for…
-
### System Info
```shell
(habanalabs-venv) (habanalabs-venv) root@vmInstancetmhmacpr:~/lier_workload/test# python inference_test.py
/usr/lib/python3.10/inspect.py:288: FutureWarning: `torch.distrib…
-
### 🐛 Describe the bug
In PyTorch 2.5.1, it has been observed that tests involving dynamic shapes get stuck indefinitely. This behavior was not observed in PyTorch 2.4.0, where the same dynamic sha…
-
### Your current environment
```text
PyTorch version: 2.2.0a0+git8964477
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
…
-
### System Info
```shell
Optimum Habana version v1.12.1
Synapse 1.16.2
docker vault.habana.ai/gaudi-docker/1.16.2/ubuntu22.04/habanalabs/pytorch-installer-2.2.2:latest
```
### Information
- [ ] …
-
I have been staging some updates testing the tgi-gaudi software with llama 405B fp8, i am waiting for habana optimum to approve the PR, and then I will submit a pr for huggingface/tgi_gaudi and will s…
-
### 🐛 Describe the bug
When using compile mode, i am getting graph breaks due with following errors
"[rank0]:I0702 10:23:29.307000 139872906987520 torch/_dynamo/variables/higher_order_ops.py:468] …
-
The container file https://github.com/containers/ai-lab-recipes/blob/main/training/intel-bootc/Containerfile does not contain necessary bits and pieces to setup InfiniBand Intel Gaudi devices. Without…
tiran updated
5 months ago
-
### Your current environment
```text
The output of `python collect_env.py`
```
### How you are installing vllm
We are using `v0.5.3.post1+Gaudi-1.18.0` and image https://github.com/HabanaAI/vll…
-
Hi, I need to run MLPerf 2.0 Intel-Habana Bert training on Aws Gaudi1 processor with image Deep Learning AMI Habana PyTorch 1.12.0 SynapseAI 1.6.0 (Ubuntu 20.04) 20220928. Followed below readme
Rea…