uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Apache License 2.0
1.78k stars 285 forks source link

tf_dataset: enable repeat() with warnings #677

Closed chongxiaoc closed 3 years ago

chongxiaoc commented 3 years ago

Change runtime error into warnings. Add warnings check in unit tests as well.

codecov[bot] commented 3 years ago

Codecov Report

Merging #677 (374e678) into master (b31eae9) will decrease coverage by 0.03%. The diff coverage is 20.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #677      +/-   ##
==========================================
- Coverage   85.79%   85.76%   -0.04%     
==========================================
  Files          84       84              
  Lines        4928     4931       +3     
  Branches      779      779              
==========================================
+ Hits         4228     4229       +1     
- Misses        561      563       +2     
  Partials      139      139              
Impacted Files Coverage Δ
petastorm/tf_utils.py 84.02% <20.00%> (-1.08%) :arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update b31eae9...374e678. Read the comment docs.

chongxiaoc commented 3 years ago

@selitvin What does the coverage test check? Only in examples or every unit test? I thought some of the missed lines should be covered by unit tests.