-
Hello Allegro Team,
I hope this message finds you well. I would like to propose the integration of xDiT, a scalable inference engine for Diffusion Transformers (DiTs), into the Allegro ecosystem. x…
-
-
## ❓ Questions and Help
Fsdp can be well expressed by spmd, but hsdp seems to be unable to be expressed. Is there any way to express hsdp in spmd?
-
**Motivation:** So far, DAPHNE only supports data-level parallelism by executing the same operations on different chunks of the input data. This is implemented in DAPHNE’s vectorized engine. However, …
-
As mentioned in the paper https://arxiv.org/abs/2207.00032, DeepSpeed inference supports pipeline parallelism, including hybrid scheduling, offloading activations, and communication, which have led to…
-
**Describe the bug**
In Hybrid Engine, the `apply_tensor_parallelism()` is not called when model inference container requires tp > 1 but self.mpu is None. For example, for a large model in Zero3, …
-
This page is accessible via [roadmap.vllm.ai](https://roadmap.vllm.ai)
### Themes.
As before, we categorized our roadmap into 6 broad themes: broad model support, wide hardware coverage, state of…
-
project: https://compilers.cs.uni-saarland.de/projects/wfv/
papar: https://compilers.cs.uni-saarland.de/papers/karrenberg_wfv.pdf
slide: https://compilers.cs.uni-saarland.de/projects/wfv/wfv_cgo11_s…
-
Based on ticket request #[RITM0560743](https://uabprod.service-now.com/nav_to.do?uri=%2Fsc_req_item.do%3Fsys_id%3D34fe17a91bc95d902e00eb93604bcb58), the GROMACS software is updated on Cheaha with supp…
-
Does Horovod support the following parallelism setup? => pipeline parallelism, but different stages of the pipeline have different number of data parallel ranks.
For example, consider a model which…