issues
search
pytorch
/
data
A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
BSD 3-Clause "New" or "Revised" License
1.08k
stars
142
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fork dataloader __init__ instead of patching samplers
#1281
andrewkho
closed
4 hours ago
1
Importing `torchdata.stateful_dataloader` hides `torch` RandomSampler and BatchSampler
#1280
byi8220
closed
4 hours ago
3
Save state in dataset_iter_state when dataset is also an iterator
#1279
gokulavasan
closed
1 week ago
5
Adding state parser utility that can be used for retrieving and modifying worker states
#1278
gokulavasan
opened
2 weeks ago
1
add deprecation warning for deprecated modules
#1277
andrewkho
closed
2 weeks ago
1
add HF test again
#1276
andrewkho
closed
2 weeks ago
1
README fix
#1275
andrewkho
closed
2 weeks ago
1
Add huggingface regression test
#1274
andrewkho
closed
2 weeks ago
1
fix for iter called twice
#1273
andrewkho
closed
2 weeks ago
2
Handle case where state is a tensor
#1272
gokulavasan
closed
2 weeks ago
1
Returning tensor instead of dict for state_dict causes failure
#1271
gokulavasan
closed
2 weeks ago
2
Enable Append Mode in SaverIterDataPipe
#1270
rravu3
opened
3 weeks ago
1
Make DistributedSampler stateful
#1269
gokulavasan
opened
3 weeks ago
1
State_dict on dataset seems to be called more often than expected
#1268
gokulavasan
opened
3 weeks ago
2
iter(dataset) is called twice for certain cases of state restore of IterableDataset
#1267
gokulavasan
closed
2 weeks ago
3
Incremental state: fix flatten None handling
#1266
gokulavasan
closed
4 weeks ago
4
GDriveReaderDataPipe complains "using a sharing/viewing link instead of a download link"
#1265
huaixv
opened
1 month ago
0
Implement incremental state transfer from worker to dataloader process #1262
#1264
gokulavasan
closed
1 month ago
7
Update README.md
#1263
andrewkho
closed
2 weeks ago
2
Implement incremental state transfer from worker to dataloader process
#1262
gokulavasan
closed
1 month ago
1
Remove unnecessary print
#1261
gokulavasan
closed
1 month ago
2
Update state_dict() request at time 0 to include worker state
#1260
andrewkho
closed
2 weeks ago
16
StatefulDataLoader stores worker state twice if the IterableDataset is also an Iterator
#1259
gokulavasan
closed
1 month ago
0
Save iterator state once instead of storing it again in dataset state
#1258
gokulavasan
closed
1 month ago
4
Shard StatefulDataLoader tests
#1257
andrewkho
closed
1 month ago
3
MacOS state_dict tests in CI are failing during shutdown
#1256
andrewkho
closed
1 month ago
2
[do not review] check if test_state_dict or test_dataloader is the culprit
#1255
andrewkho
closed
1 month ago
0
remove label filters for test ci
#1254
andrewkho
closed
1 month ago
6
Add message about s3 iterdata pipes deprecation
#1253
gokulavasan
closed
1 month ago
4
Add an additional test for fast-state-dict request problem when snapshot_every_n_steps > 1
#1252
andrewkho
closed
1 month ago
3
fix an edge case bug where state is incomplete if request checkpoint after resume
#1251
andrewkho
closed
1 month ago
3
update worker keys and add test
#1250
andrewkho
closed
1 month ago
2
Update actions/setup-python from v4 -> v5
#1249
andrewkho
closed
1 month ago
1
add timing info to ci, and update tests for mac to use forkserver
#1248
andrewkho
closed
2 months ago
3
[StatefulDataLoader] macOS tests are too slow
#1247
andrewkho
closed
2 months ago
0
Don't patch _worker_loop
#1246
andrewkho
closed
2 months ago
4
Stateful dataloader README
#1245
andrewkho
closed
2 months ago
4
torchdata not compatible with torch 2.3.0
#1244
mmdanziger
opened
2 months ago
3
make torchdata default imports lazy
#1243
andrewkho
closed
2 months ago
10
Attempt fix to linux wheels build
#1242
gokulavasan
closed
2 months ago
2
Stateful dataloader
#1241
andrewkho
closed
2 months ago
9
Move to removesuffix string method after python 3.8 support is dropped
#1240
gokulavasan
opened
3 months ago
0
removesuffix is not available 3.8, thus reverting the changes to rstrip
#1239
gokulavasan
closed
3 months ago
3
Skip tests that are timing out and slow tests
#1238
gokulavasan
closed
3 months ago
3
skip mprs tests
#1237
gokulavasan
closed
3 months ago
0
Fix dprs tests
#1236
gokulavasan
closed
3 months ago
0
Address remaining mypy errors - mypy checks passing now
#1235
gokulavasan
closed
3 months ago
2
Fix two types of issues raised by mypy - implicit optional issues and arg-type mismatch
#1234
gokulavasan
closed
3 months ago
5
Remove torchtext tests
#1233
gokulavasan
closed
3 months ago
2
Set mypy version to match pytorch core
#1232
gokulavasan
closed
3 months ago
1
Next