databricks / spark-deep-learning

Deep Learning Pipelines for Apache Spark
https://databricks.github.io/spark-deep-learning
Apache License 2.0
1.99k stars 494 forks source link

[WIP] drop Spark <2.3 support and build against Keras 2.2.2 and TF 1.10.0 #149

Closed mengxr closed 6 years ago

mengxr commented 6 years ago

Still a WIP.

We will add Spark 2.4 support after RC is out.

codecov-io commented 6 years ago

Codecov Report

Merging #149 into master will decrease coverage by 12.1%. The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff             @@
##           master     #149       +/-   ##
===========================================
- Coverage   85.37%   73.27%   -12.11%     
===========================================
  Files          34       11       -23     
  Lines        1922      494     -1428     
  Branches       41       41               
===========================================
- Hits         1641      362     -1279     
+ Misses        281      132      -149
Impacted Files Coverage Δ
python/sparkdl/graph/pieces.py
python/sparkdl/udf/keras_image_model.py
python/sparkdl/graph/input.py
python/sparkdl/param/converters.py
python/sparkdl/graph/tensorframes_udf.py
...n/sparkdl/estimators/keras_image_file_estimator.py
python/sparkdl/transformers/keras_tensor.py
python/sparkdl/param/image_params.py
python/sparkdl/transformers/named_image.py
python/sparkdl/transformers/tf_image.py
... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update f42fb76...aaa280d. Read the comment docs.

jkbradley commented 6 years ago

Shall we close this since it has been subsumed by https://github.com/databricks/spark-deep-learning/pull/151 ? (I checked the newer one vs. this one.)

mengxr commented 6 years ago

closed!