-
### Before reporting an issue
- [X] I have read and understood the above terms for submitting issues, and I understand that my issue may be closed without action if I do not follow them.
### Are…
-
**Describe the issue**:
Some follow-up to: https://github.com/dask/distributed/issues/8761
After fixing above issue already in https://github.com/dask/distributed/pull/8762, the next big thing t…
-
Something like https://github.com/jdehlin/CacheSleeve that can store locally, while also being distributed (2-tier). With automatic invalidation as we do with the message bus in O1.
Also would be u…
-
This is a non-exhaustive list of the tasks still remaining for the natESM sprint on CLEO (likely in priority order):
- [x] Fix the distributed memory parallelization (currently there are difference…
-
**System information**
- Have I written custom code: YES
- OS Platform and Distribution: CentOS 7.3
- TensorFlow installed from: pip
- TensorFlow version: 2.3.0
- Python version:3.7.7
- CPU ON…
-
Hi,
I recently came across an issue when using context parallelism for splitting long sequence with NeMo and Transformer Engine. The context parallelism splits sequence length across GPUs and use p…
-
Hello,
We are interested in extending this software to include shared- and distributed-memory parallelization for execution of large problems on many CPUs. Before looking into this, I was wonderin…
-
## Issue description
When I am running distributed and I simply set `CUDA_VISIBLE_DEVICES` in each rank:
- Running `torch.distributed.barrier()` makes rank 1 occupy GPU memory on the GPU of rank 0…
-
Currently, caching is done by a Guava in-memory cache that lives within the JVM. As the end goal of this microservice is to be cloud-native using k8s, a distributed caching service like Redis may be m…
-
## Environment
- OS: [Ubuntu Ubuntu 22.04.2]
- Hardware (GPU, or instance type): [DGX with 8xH100, CUDA 12.0]
## To reproduce
Steps to reproduce the behavior:
Using the mosaic [codeba…