uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Apache License 2.0
1.78k stars 285 forks source link

Bugfix: S3FSWrapper is deprecated at s3fs 0.5.0 #611

Closed dmcguire81 closed 3 years ago

dmcguire81 commented 4 years ago

Enforce the minimal s3fs version at which S3FSWrapper is not needed. Fixes #609.

codecov[bot] commented 4 years ago

Codecov Report

Merging #611 into master will not change coverage. The diff coverage is 50.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #611   +/-   ##
=======================================
  Coverage   85.68%   85.68%           
=======================================
  Files          87       87           
  Lines        4994     4994           
  Branches      795      795           
=======================================
  Hits         4279     4279           
  Misses        578      578           
  Partials      137      137           
Impacted Files Coverage Δ
setup.py 0.00% <ø> (ø)
petastorm/fs_utils.py 91.75% <50.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 4fe92a4...65a0801. Read the comment docs.