search

uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Apache License 2.0
1.78k stars 285 forks source link

[WIP] Fix bug: cannot call enumerate(dataloader) more than once #543

Closed liangz1 closed 4 years ago

codecov[bot] commented 4 years ago

Codecov Report

Merging #543 into master will increase coverage by 3.60%. The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #543      +/-   ##
==========================================
+ Coverage   82.88%   86.48%   +3.60%     
==========================================
  Files          85       85              
  Lines        4721     4721              
  Branches      744      744              
==========================================
+ Hits         3913     4083     +170     
+ Misses        678      517     -161     
+ Partials      130      121       -9
Impacted Files Coverage Δ
petastorm/py_dict_reader_worker.py 95.23% <0.00%> (+0.79%) :arrow_up:
petastorm/spark/spark_dataset_converter.py 91.76% <0.00%> (+1.49%) :arrow_up:
petastorm/arrow_reader_worker.py 92.00% <0.00%> (+2.00%) :arrow_up:
petastorm/compat.py 100.00% <0.00%> (+39.02%) :arrow_up:
..._dataset_converter/tests/test_converter_example.py 100.00% <0.00%> (+46.66%) :arrow_up:
examples/spark_dataset_converter/utils.py 100.00% <0.00%> (+62.50%) :arrow_up:
..._dataset_converter/tensorflow_converter_example.py 85.10% <0.00%> (+85.10%) :arrow_up:
...ark_dataset_converter/pytorch_converter_example.py 94.00% <0.00%> (+94.00%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 83a02df...a5cbcb8. Read the comment docs.