-
# Collectives market analysis
## What other software are we looking at?
* **Focus on enterprise knowledgebase parts:**
* [Atlassian Confluence](https://www.atlassian.com/software/confluence)
…
-
Hi, I have following setup:
- Transformer model with N layers scanned over input
- fully sharded data parallel sharding
- asynchronous communications (latency-hiding scheduler, pipelined all-gather…
-
### 🐛 Describe the bug
Hi! I'm trying to run PyTorch with CUDA-aware MPI as backend and I'm consistently running into the same error with any collective operation. I am pretty confident I have instal…
-
### System Info
- `transformers` version: 4.39.0
- Platform: Linux-5.15.0-78-generic-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.19.4
- Safetensors version: 0.4.1…
-
Dear developers!
Actually, my request belongs to [this](https://github.com/NU-CUCIS/ALIGNNTL) reporistory for the ALIGNN transfer learning project, but since I have not received a reply on the issue …
-
### 🐛 Describe the bug
Consider the following piece of code:
```python
# run me with
# torchrun --nproc_per_node=2 repro.py
import os
import torch
from torch import distributed as dist
…
-
### 🚀 The feature, motivation and pitch
Currently, the FX graph tracing (such as the one used in `aot_module`) seems not supporting collective functions such as `allgather`.
We may face some err…
-
### 🚀 The feature, motivation and pitch
Current remapping adds copy_ operation to the graph which effectively adds significant number on conditions on tensor strides / sizes and result with DataDepen…
-
```
This is to log the UPC collectives 2.0 extensions.
For reference, the UPC Collectives 2.0 proposal can be found here:
http://upc.lbl.gov/publications/UPC-Collectives-PGAS11.pdf
```
Original is…
-
When I click on an App to manage it in Safari while circles is activated,
it is not possible to reach the sidebar for it.
Here I cliced on Calendar. But it appears Two-Factor TOTP-Provider in th…