-
Currently the TGI have [tgi-gaudi](https://github.com/huggingface/tgi-gaudi) to support the HPU for Gaudi 2 and also VLLM is included their [roadmap in Q1 2024](https://github.com/vllm-project/vllm/is…
-
T2V is planned to enable inferencing LLMs like Stable Diffusion on CPU/GPU, and training on Habana Gaudi/DG2, as well as improving the Generated Video quality, like more realistic frame, and coherency…
-
### Priority
Undecided
### OS type
Ubuntu
### Hardware type
Gaudi2
### Installation method
- [X] Pull docker images from hub.docker.com
- [ ] Build docker images from source
### Deploy method
…
-
### Description
The example pages under each library may contain examples contributed by the Ray Community. We want to demarcate them clearly so that readers understand they are not maintained by the…
-
### Description & Motivation
For below example, model is being compiled, `DDPStrategy` is passed to Trainer, then during fit method `DDPStrategy` is being applied, so forward is compiled but `_pre_…
-
Colossal-AI may be used to reduce GPU Memory consumption during training (but may cause more training time).
https://github.com/hpcaitech/ColossalAI
Colossal-AI is used for acceleration of AIGC (A…
-
This issue is used by [lightning-probot](https://github.com/PyTorchLightning/probot) to manage subscriptions to labels. To subscribe yourself to a label, add a line `* label @yourusername`, or add you…
-
### Your current environment
/usr/lib/python3.10/inspect.py:288: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead
return isinstance(objec…
-
At some point `pytorch-lightning` will be deprecated in favor of `lightning`.
We can start migrating as well.
Addresses #2192.
- [ ] code base
- [ ] docs
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
/usr/lib64/python3.11/inspect.py:389: FutureWarning: `torch.distributed.reduce_…