-
It's not possible to calculate the grouped mean for a very large column of pyarrow type.
```python
import pandas as pd
import numpy as np
import pyarrow as pa
import dask.dataframe
import da…
-
PS E:\githubProjects\CVF-SID_PyTorch\src> python test.py --device 0 --config ../models/CVF_SID/SIDD_Val/config.json --resume ../models/CVF_SID/SIDD_Val/model_best.pth
Traceback (most recent call last…
-
### Bug description
Would it be possible for Lightning to raise an error if `SLURM_NTASKS != SLURM_NTASKS_PER_NODE` in case both are set?
With a single node the current behavior is:
* `SLURM_NT…
-
### Describe the Bug
The .NET 9 source contains the file `src/wpf/src/Microsoft.DotNet.Wpf/src/PresentationCore/System/Windows/Media/Resources/ColorProfiles/sRGB.icm`. This file may not be dist…
-
## Issue Description
### Overview
I'm currently utilizing Celery within a distributed system to handle various tasks across remote workers. However, there are instances where these workers may be …
urzbs updated
3 weeks ago
-
When a project mentions 'distributed', I think of things like [wesher](https://github.com/costela/wesher), [Consul](https://consul.io), and [GlusterFS](https://www.gluster.org/), which are distributed…
-
Suggestions of key points to cover:
- clusters aren't just "super fast" computers
- importance is parallelization -- running things simultaneously (somehow)
- talk about sample problems that paral…
-
In https://github.com/dask/distributed/issues/7726 and https://github.com/dask/distributed/issues/7770 we've dug fairly far into what is happening with object destruction and the impacts for users of …
-
Hello, 😄
I'm a data scientist/data engineer working on a specific workflow where I need to process a huge amount of documents so i tried using `distributed.Queue` to right a producer/consumer p…
-
When using a distributed build system, where -j is often much higher than #cores, it seems best to have a "local" pool for all non-distributed tasks to avoid overloading the local system. Unfortunate…