uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Apache License 2.0
1.78k stars 285 forks source link

Don't exclude fields not supported by pyarrow 0.15 from test data. #622

Closed selitvin closed 3 years ago

selitvin commented 3 years ago

That's because we no longer support 0.15

codecov[bot] commented 3 years ago

Codecov Report

Merging #622 (7f2233b) into master (8867089) will increase coverage by 0.24%. The diff coverage is 100.00%.

:exclamation: Current head 7f2233b differs from pull request most recent head 0505026. Consider uploading reports for the commit 0505026 to get more accurate results Impacted file tree graph

@@            Coverage Diff             @@
##           master     #622      +/-   ##
==========================================
+ Coverage   85.93%   86.18%   +0.24%     
==========================================
  Files          84       84              
  Lines        4957     5045      +88     
  Branches      788      788              
==========================================
+ Hits         4260     4348      +88     
- Misses        558      559       +1     
+ Partials      139      138       -1     
Impacted Files Coverage Δ
petastorm/workers_pool/exec_in_new_process.py 100.00% <ø> (ø)
setup.py 0.00% <ø> (ø)
petastorm/reader_impl/arrow_table_serializer.py 100.00% <100.00%> (ø)
petastorm/cache.py 100.00% <0.00%> (ø)
petastorm/selectors.py 100.00% <0.00%> (ø)
examples/mnist/tests/conftest.py 100.00% <0.00%> (ø)
petastorm/benchmark/dummy_reader.py 0.00% <0.00%> (ø)
examples/mnist/tests/test_tf_mnist.py 100.00% <0.00%> (ø)
..._dataset_converter/tests/test_converter_example.py 100.00% <0.00%> (ø)
petastorm/hdfs/tests/test_hdfs_namenode.py 99.65% <0.00%> (+<0.01%) :arrow_up:
... and 23 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 20e46e0...0505026. Read the comment docs.