-
### System Info
TGI-gaudi 2.0.4 docker image.
Model = meta-llama/Meta-Llama-3.1-70B-Instruct
HW = Gaudi2, 4 cards
python 3.11
langchain 0.2.12
langchain-core 0.2.28…
-
Do you provide a Docker Image for Gaudi Website itself? I would love to have it locally, but my environment is not Ubuntu :( RedHat (based on http://marmelab.com/blog/2014/05/12/gaudi-news-gaudi-io-ap…
-
I have been staging some updates testing the tgi-gaudi software with llama 405B fp8, i am waiting for habana optimum to approve the PR, and then I will submit a pr for huggingface/tgi_gaudi and will s…
-
We want to verify that FSDP works in the following scenarios:
- [x] #203
- [x] #204
- [x] #205
- [x] #206
- [ ] #207
- [x] #208
-
### Priority
Undecided
### OS type
Ubuntu
### Hardware type
Gaudi2
### Installation method
- [ ] Pull docker images from hub.docker.com
- [ ] Build docker images from source
### Deploy method
…
-
### System Info
```shell
Image: vault.habana.ai/gaudi-docker/1.17.1/ubuntu22.04/habanalabs/pytorch-installer-2.3.1:latest
harware: Habana Labs Gaudi HL205 Mezzanine Card with HL-2000 AI Training …
-
[here](https://lhcb.github.io/starterkit-lessons/first-analysis-steps/lhcb-dev.html) it looks like DaVinci/v45r8 would not be anymore compatible with whatever the changes happened in Analysis.
```
…
-
### System Info
Optimum Habana: 1.10.4
Synapse: 1.14.0
Dockerfile:
```
FROM vault.habana.ai/gaudi-docker/1.14.0/ubuntu22.04/habanalabs/pytorch-installer-2.1.1:latest
# Installs pdsh and upg…
-
We should create a policy and guiding document how to deal with new dependencies or updates of existing dependencies.
Some thoughts:
- new dependencies should be avoided unless they bring merit.…
tiran updated
2 months ago
-
It seems the command `gaudi enter ` seems not work on Mac OS. It fail with this log:
``` bash
$ gaudi enter nginx
Retrieving ns-enter image ...
2014/07/27 12:38:48 exec: "run": executable file not fo…