-
### 🐛 Describe the bug
For all torchdata wheels, in order to provide the integration of AWSSDK, we statically linked `OpenSSL` to `_torchdata.so`, we should prevent any symbol from OpenSSL exposed …
-
-
### 🐛 Describe the bug
```python
dp = ...
dp = dp.sharding_filter()
rs = MultiProcessingReadingService(num_workers=4)
dataloader = DataLoader2(dp, reading_service=rs)
for _ in dataloader:
…
-
-
### 🚀 The feature
From what I can tell torchdata actually had type stubs but mypy won't pick it up because it is missing the `py.typed` marker file (see: https://mypy.readthedocs.io/en/stable/running…
-
### 🐛 Describe the bug
```bash
$ conda install -c pytorch torchdata -y
$ python -c "import torchdata"
Traceback (most recent call last):
File "", line 1, in
File "/home/erip/anaconda3/env…
-
## 🚀 Deprecation of TorchText releases
As of September 2023 we have paused active development of TorchText because our focus has shifted away from building out this library offering.
We would l…
-
It would be nice when using `datasets` with a PyTorch DataLoader to be able to resume a training from a DataLoader state (e.g. to resume a training that crashed)
What I have in mind (but lmk if you…
-
Check whether we can adopt the PyTorch S3 support:
https://pytorch.org/data/main/generated/torchdata.datapipes.iter.S3FileLoader.html
-
### Add Link
- [Source code permalink](https://github.com/pytorch/tutorials/blob/653719940f7c4d908811da415f190465d8c3189d/advanced_source/ddp_pipeline.py#L175)
- [Online docs link](https://pytorch.o…