search

uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Apache License 2.0
1.78k stars 285 forks source link

Add a helper method `edit_field(name, numpy_dtype, shape, nullable=False)` #526

Closed WeichenXu123 closed 4 years ago

WeichenXu123 commented 4 years ago

Add a helper method edit_field(name, numpy_dtype, shape, nullable=False) It is used in TransformSpec. This help user to avoid setting wrong field order in edit_fields tuples.

codecov[bot] commented 4 years ago

Codecov Report

Merging #526 into master will increase coverage by 0.00%. The diff coverage is 100.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #526   +/-   ##
=======================================
  Coverage   86.31%   86.32%           
=======================================
  Files          81       81           
  Lines        4501     4503    +2     
  Branches      726      726           
=======================================
+ Hits         3885     3887    +2     
  Misses        504      504           
  Partials      112      112
Impacted Files Coverage Δ
petastorm/transform.py 86.20% <100.00%> (+1.02%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 5e12f27...4f3f3d8. Read the comment docs.