-
### š Describe the bug
Cannot import `traverse_dps` from `torch.data.utils.graph`.
```
from torchtext.datasets import WikiText2
```
does not work, but instead throws the error:
```
[/usr/locaā¦
-
### š The feature
```
import torchdata.datapipes as dp
from torch.utils.data.datapipes.iter.sharding import SHARDING_PRIORITIES
from torchdata.dataloader2 import MultiProcessingReadingService, Dā¦
-
In a distributed setting, `len(dataloader)` will return:
- `len(dataset) // (batch_size * num_GPUs)` if `dataset` is a map-style dataset
- `len(dataset) // batch_size` if `dataset` is a datapipe
ā¦
-
### Tell us more about this new feature.
I'm working in a Kubernetes/Kubflow environment deployed on EC2 with S3 credentials set up using role_arn with web_identity_token_file and keep receiving thā¦
-
A p4d.24xl offers 4x100Gbps of throughput. 25 threads will most likely not max out available bandwidth. Allowing configuration of `executorPoolSize` would allow for more threads, and faster s3 throughā¦
-
### Summary
in the scenario of imbalanced datasets, the use of the current samplers may not assist with imbalanced samples.
I am currently trying to get rid of samples with only 0 metre heights iā¦
-
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What happened?
Use Google Colab and run into problems:
Failed to connecā¦
-
I was going through the documentation and it points to using `wds.Processor` ([here](https://webdataset.github.io/webdataset/howitworks/)) to add a preprocessing pipeline to the data.
However, in thā¦
-
- PyTorch-Forecasting version: 1.0.0
- PyTorch version: 2.1.0
- Python version: 3.9.7
- Operating System: win 10
I want to import optimize_hyperparameters using: from pytorch_forecasting.models.ā¦