-
## Describe the bug
This is very similar or maybe the same as #211 . But I am writing a new issue because it is not related to Windows.
I am on Azure cloud on a 4 x A100 GPU Linux machine.
I inst…
-
### Describe the bug
!pip install accelerate>=0.16.0 torchvision transformers>=4.25.1 datasets>=2.19.1 ftfy tensorboard Jinja2 peft==0.7.0
ERROR: pip's dependency resolver does not currently take …
-
**Describe the issue**:
I am running into an issue with deploying dask using LocalCUDACluster() on an HPC. I am trying to do RandomForest, and the amount of data I am inputting exits the limit of a si…
-
### What happened?
When running `open_mfdataset()` with `parallel=True` using a dask cluster with a worker memory limit of less than the size of the dataset, the dataset will not open. This is rela…
-
## 🚀 Feature
Giving the option to shut down the automatic data distributed sampler when using StreamingDataset.
### Motivation
When I use StreamingDataset in 'DDP' environment, the datase…
-
Hello, I used the following command to train
"python -m torch.distributed.launch --nproc_per_node 8 --master_port 12345 main.py --cfg configs/swin/swin_tiny_patch4_window7_224.yaml --batch-size 128 -…
-
## Environment info
- `adapters` version: latest
Below output is from colab
- `transformers` version: 4.43.4
- Platform: Linux-6.1.85+-x86_64-with-glibc2.35
- Python version: 3.10.12
- …
-
Sometimes datasets need to be created in bulk, eg. distributed sampling at many places with multiple value types. Using a spreadsheet can make this simpler to repeat similar information.
-
### 🐛 Bug
ARNING] using untested triton version (2.3.1), only 1.0.0 is known to be compatible
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using…
-
# Implement Multi-GPU Support in Anomalib
- Depends on: https://github.com/openvinotoolkit/anomalib/issues/2257
## Background
Anomalib currently uses PyTorch Lightning under the hood, which provi…