-
Icechunk does support distributed writing of Arrays. However, currently Icechunk does not allow writing arrays via `dask.array.store` with distributed or multiprocessing schedulers.
This is becaus…
-
I have an API that will always run on at least two instances. There are a couple of background jobs I hoped to use Job Queues for. I’m curious if the library adequately prevents two instances from si…
-
This is to add the following knowledge to HPC Handbook including code examples with easy-setup experiment.
- GPU Computing
- Distributed GPU Computing
- Distributed Training
- Distributed Inferenc…
-
## Overview
We need a loose, multi-cluster diagram for a geo-distributed 10k user architecture as the first step in executing a 10k user reference architecture. This diagram would not go directly into…
-
## User Interface
- [x] Sail CLI (#245)
- [x] Sail configuration (#279)
## Core Functionalities
- [x] Distributed processing setup (#244)
- [x] Distributed job stages and shuffle (#265)
- [x] …
-
Thank you for this library
We are trying to run this in azure functions, where filesystem is not persistent.
Is there anyway we can avoid `working_dir` ? If we attach our own vector db, key value …
-
### 🐛 Describe the bug
When trying to run distributed/run_dist_inference.sh . It has below error.
[rank0]:[rank0]: model = _load_model(builder_args)
[rank0]:[rank0]: File "/scratch/grace/torc…
-
When I use FastBuild with -dist arguments to user distributed build，it will compilation fail sometime。
Log is:
![fastbuilderror1](https://github.com/user-attachments/assets/cfdb6f48-d95c-42cc-8461-…
3m123 updated
3 weeks ago
-
-
I want to be able to run aggregations on certain columns based on certain rows which are filtered by user selecting the filter criteria. The filter includes a few columns, time window etc. The expensi…