-
Check whether we can adopt the PyTorch S3 support:
https://pytorch.org/data/main/generated/torchdata.datapipes.iter.S3FileLoader.html
-
### Summary
in the scenario of imbalanced datasets, the use of the current samplers may not assist with imbalanced samples.
I am currently trying to get rid of samples with only 0 metre heights i…
-
### Describe the question.
I seek to write external source to load webdatasets from S3. And I want to adopt the parallel external source to accelerate the loading.
Usually, the shards of webdata…
-
Hi there, thanks for the code. However, when I tried to test it, I suffered from lots of dependency failures and so on, mainly due to the Dataset4EO, mmcv and torch. Could you be so kind to share your…
-
-
### 🚀 The feature
**Note that this is a request for comment; currently, there is no plan to make TorchData a standalone library.** We would like to solicit feedback from the community.
Proposal:…
-
### 🐛 Describe the bug
When running prefetch on multiple branches of a forked datapipe, it is possible to trigger a race condition.
```python
import time
import torchdata.datapipes as dp
from…
-
## 🐛 Bug
I believe this is a duplicate of #7247 (but for `torch` 2.4.1).
## To Reproduce
Steps to reproduce the behavior:
```python
>>> import dgl
Traceback (most recent call last):
…
-
I tried to run the evaluation using the pretrained checkpoint [PerAct - 512 Latents](https://github.com/peract/peract/releases/download/v1.0.0/peract_600k_512latents.zip) and the val dataset provided.…
-
### 🐛 Describe the bug
```
python -u -m pytest -s -v test/inductor/test_cpu_select_algorithm.py -k test_int8_woq_mm_batch_size_32_in_features_128_out_features_65_cpu_bfloat16
python -u -m pytes…