-
### Feature request
I see the release version 1.12 has supported fp8, but I didn't see any example code for how to train LLM by using FP8.
How can I use FP8 to train model?
### Motivation
I want t…
-
-
PR #3469 Added the infrastructure for doing backend-specific verifiers. You can see the rationale behind that in issue #3469.
It also added such verifiers for the `OpenCL` and `Interpreter` backend…
-
At some point `pytorch-lightning` will be deprecated in favor of `lightning`.
We can start migrating as well.
Addresses #2192.
- [ ] code base
- [ ] docs
-
Summary of request: Add a new organization to ROR
Name of organization: Universidad de las Artes*es
Website: https://isa.cult.cu
Domains: isa.cult.cu
Link to publications:
Organization type: Ed…
-
Environment:
OpenShift 4.13, Proxyed to image repo quay.io and registry.redhat.io on Harbor using ImageDigestMirrorSet and ImageTagMirrorSet.
RHODS operator install and instance created normally.…
-
Currently the TGI have [tgi-gaudi](https://github.com/huggingface/tgi-gaudi) to support the HPU for Gaudi 2 and also VLLM is included their [roadmap in Q1 2024](https://github.com/vllm-project/vllm/is…
-
Hi, I need to run MLPerf 2.0 Intel-Habana Bert training on Aws Gaudi1 processor with image Deep Learning AMI Habana PyTorch 1.12.0 SynapseAI 1.6.0 (Ubuntu 20.04) 20220928. Followed below readme
Rea…
-
### 🐛 Describe the bug
The current Dynamo captures torch.cuda.stream with https://github.com/pytorch/pytorch/pull/93808. However, for other backends with streams, the capture wouldn't happen. There s…
-
### System Info
```shell
Optimum-habana - 1.7.4
Synapse AI - 1.12.0
Docker - 1.12.0-463
Gaudi2 (HLS 225) - 1x and 8x.
```
### Information
- [X] The official example scripts
- [ ] My own modifie…